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Abstract 

O 

We make a comprehensive study of the theory and phenomenology of a low energy 
■ supersymmetric standard model originating from a string-inspired Eq grand unified 

gauge group. The Exceptional Supersymmetric Standard Model (ESSM) consid- 
J> ' ered here is based on the low energy SM gauge group together with an extra Z 1 

corresponding to an extra U(1)n gauge symmetry under which right-handed neu- 
trinos have zero charge. The low energy matter content of the ESSM corresponds 
to three 27 representations of the Eq symmetry group, to ensure anomaly cancel- 
lation, plus an additional pair of Higgs-like doublets as required for high energy 



gauge coupling unification. The ESSM is therefore a low energy alternative to the 
MSSM or NMSSM. The ESSM involves extra matter beyond the MSSM contained 
in three 5 + 5* representations of SU(5), plus three SU(5) singlets which carry 



U(1)n charges, one of which develops a VEV, providing the effective fi term for the 
Higgs doublets, as well as the necessary exotic fermion masses. We explore the RG 



flow of the ESSM and examine theoretical restrictions on the values of new Yukawa 
couplings caused by the validity of perturbation theory up to the Grand Unification 
scale. We then discuss electroweak symmetry breaking and Higgs phenomenology, 
and establish an upper limit on the mass of the lightest Higgs particle which can be 
significantly heavier than in the MSSM and NMSSM, in leading two-loop approxi- 
mation. We also discuss the phenomenology of the Z' and the extra matter, whose 
discovery will provide a smoking gun signal of the model. 
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1. Introduction 



Despite the absence of any evidence for new particles beyond those contained in the 
Standard Model (SM), the cancellation of quadratic divergences pQ remains a compelling 
theoretical argument in favour of softly broken supersymmetry (SUSY) which stabilises 
the Electro- Weak (EW) scale and solves the hierarchy problem [2j (for a recent review 
see SUSY also facilitates the high energy convergence of the SM gauge couplings [4] 
which allows the SM gauge group to be embedded into Grand Unified Theories (GUTs) [5J 
based on simple gauge groups such as SU(5), 5*0(10) or E e . The rational U(l)y charges, 
which are postulated "ad hoc" in the case of the SM, then appear in a natural way in the 
context of SUSY GUT models after the breakdown of the extended symmetry at some 
high energy scale Mx, providing a simple explanation of electric charge quantisation. 

An additional motivation to consider models with softly broken SUSY is associated 
with the possible incorporation of the gravitational interactions. The local version of 
SUSY (supergravity) leads to a partial unification of the SM gauge interactions with 
gravity. However SUpergGRAvity (SUGRA) itself is a non-renormalisable theory and 
has to be considered as an effective low energy limit of some renormalisable or even finite 
theory. Currently, the best candidate for such an underlying theory is ten-dimensional 
heterotic superstring theory based on E 8 x E' 8 jH]. In the strong coupling regime of an 
E 8 x E' 8 heterotic string theory described by eleven dimensional SUGRA (M-theory) [7] , 
the string scale can be compatible with the unification scale Mx [B] ■ Compactification of 
the extra dimensions results in the breakdown of E$ down to E§ or one of its subgroups 
in the observable sector jU] . The remaining E' s plays the role of a hidden sector that gives 
rise to spontaneous breakdown of SUGRA, which results in a set of soft SUSY breaking 
terms ^0] characterised by the gravitino mass (1713/2) of order the EW scale 1 . 

Although the theoretical argument for low energy SUSY is quite compelling, it is worth 

emphasising that the choice of low energy effective theory at the TeV scale consistent 

with high energy conventional (or string) unification is not uniquely specified. Although 

the Minimal Supersymmetric Standard Model (MSSM) is the best studied and simplest 

candidate for such a low energy effective theory, the MSSM suffers from the /1 problem: 

the superpotential of the MSSM contains one bilinear term fiHdH u which can be present 

before SUSY is broken. As a result one would naturally expect it to be of the order of 

the Planck scale Mpi. If /i ~ Mpi then the Higgs scalars get a huge positive contribution 

~ fi 2 to their squared masses and EW Symmetry Breaking (EWSB) does not occur. On 

the other hand the parameter /1 cannot be simply omitted. If fi = at some scale Q the 

1 A large mass hierarchy between 77i 3 / 2 and Planck scale can appear because of non-perturbative 
sources of SUSY breaking in the hidden sector gauge group (for a review see [TT]V 



1 



mixing between Higgs doublets is not generated at any scale below Q due to the non- 
renormalisation theorems ^2]- In this case the minimum of the Higgs boson potential is 
attained for < Ha >= 0. Because of this down-type quarks and charged leptons remain 
massless. In order to get the correct pattern of EWSB, /x is required to be of the order of 
the SUSY breaking (or EW) scale. 

The Next-to-Minimal Supersymmetric Standard Model (NMSSM) is an attempt to 
solve the \x problem of the MSSM in the most direct way possible, by generating // 
dynamically as the low energy Vacuum Expectation Value (VEV) of a singlet field. The 
superpotential of the NMSSM is given by [T3]-[T1| 

W NMS sm = \S{H d H u ) + ^S 3 + W MSSM (ji = 0) . (1) 

The cubic term of the new singlet superfield S in the superpotential breaks an additional 
U(l) global symmetry that would appear and is a common way to avoid the axion that 
would result. However the NMSSM itself is not without problems. The NMSSM super- 
potential is still invariant under the transformations of a discrete Z 3 symmetry. This Z 3 
symmetry should lead to the formation of domain walls in the early universe between 
regions which were causally disconnected during the period of EWSB ^H] • Such domain 
structure of vacuum create unacceptably large anisotropics in the cosmic microwave back- 
ground radiation [T^]. In an attempt to break the Z 3 symmetry operators suppressed by 
powers of the Planck scale could be introduced. But it has been shown that these opera- 
tors give rise to quadratically divergent tadpole contributions, which destabilise the mass 
hierarchy once again [T7j . 

One solution to these difficulties is to consider the simplest gauge extensions of the SM 
gauge group that involve an additional non-anomalous U(l)' gauge symmetry. Models 
with an additional U(l)' factor can arise naturally out of string-inspired constructions 
^H1C2] ■ In particular one or two extra U(l)' factors may emerge in the breaking of a string- 
inspired Eq gauge group and the phenomenology of such models has been extensively 
studied in the literature [TH]. Such theories may lead to a U(l)' extension of the NMSSM 
in which a SM singlet field S couples to the Higgs doublets and yields an effective \i 
parameter ~ A < S >, while the S 3 term is forbidden by the U(l)' gauge symmetry. In 
such models the Peccei-Quinn (PQ) symmetry becomes embedded in the new U(l)' gauge 
symmetry. Clearly there are no domain wall problems in such a model since there is no 
discrete Z% symmetry. The field S is charged under the U(l)' so that its expectation value 
also gives mass to the new Z' gauge boson breaking the U(l)', in other words the would- 
be PQ axion is eaten by the Z' . The extended gauge symmetry forbids an elementary \i 
term as well as terms like S n in the superpotential. The role of the S 3 term in generating 
quartic terms in the scalar potential, which stabilise the physical vacuum, is played by 
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D-terms. 

In this paper we explore a specific Eq inspired super symmetric realisation of the above 
U(l)' type model which is capable of resolving the \x problem as in the NMSSM, but 
without facing any of its drawbacks. The total matter content of our model corresponds 
to three families of 27j representations, plus two Higgs-like doublets, consistent with 
SUSY unification. A particular feature of our model is that we assume that the Eq gauge 
group is broken at high energies down to the SM gauge group plus a particular extra 
£7(1) TV gauge symmetry in which right-handed neutrinos have zero charge and so are 
singlets and do not participate in the gauge interactions. Since right-handed neutrinos 
have zero charges they can acquire very heavy Majorana masses and are thus suitable to 
take part in the standard seesaw mechanism which yields small neutrino masses. Having 
heavy right-handed neutrinos also avoids any stringent constraints on the mass of the Z' 
boson coming from the nucleosynthesis and astrophysical data which would be present if 
the right-handed neutrinos were light. 

The above superstring inspired Eq SUSY model, henceforth referred to as the Ex- 
ceptional Supersymmetric Standard Model (ESSM), provides a theoretically attractive 
solution to the \x problem of the MSSM since the bilinear Higgs fi terms are forbidden by 
the U(1)n gauge symmetry. This model contains three pairs of candidate Higgs doublets 
Hu, H 2 i, plus three singlets Si, which carry U(1)n charge. These states all originate from 
three 27j representations and couple together according to a 27^27 'j27k coupling resulting 
in NMSSM type superpotential couplings of the form: 

W H = J2ijk ^ijkSiHijH 2 k ■ (2) 

The breaking of the EW and U(1)n gauge symmetry down to U(l) em takes place when 
some of these Higgs fields acquire VEVs. It is possible to work in a basis where only one 
family of Higgs fields and singlets acquire non-zero VEVs, which we can define to be the 
third family, and we can then define S = S3, = i?i 3, H u = H 2 ^. We shall then refer 
to the remaining first two families Si, Hx,i, H 2 ^, with % — 1, 2 as non-Higgs doublets and 
singlets. The relation of the third family Higgs so defined to the third family quarks and 
leptons is more model dependent, but in the context of Radiative EWSB (REWSB) it is 
natural to associate the third family Higgs to the third family quarks and leptons, since it 
is the large Yukawa coupling of the third family which drives the Higgs VEVs. This also 
avoids the appearance of Flavour Changing Neutral Currents (FCNCs). Then, restricting 
ourselves to Higgs fields which develop VEVs, the superpotential (J2J) reduces to 

W H -> XS(H d H u ) (3) 

which is just the NMSSM coupling in Eq. ((TJ. After the spontaneous symmetry break- 
down at the EW scale the scalar component of the superfield S acquires non-zero VEV 
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((£) = s/y/2) and an effective /j-term (/x = Xs/\^2) of the required size is automatically 
generated. The Higgs sector of the considered model contains only one additional singlet 
field and one extra parameter compared to the MSSM. Therefore it can be regarded as 
the simplest extension of the Higgs sector of the MSSM. 

It is interesting to compare the ESSM to other related models with an extra U(l)'. 
In general anomaly cancellation requires either the presence of exotic chiral supermulti- 
plets [20]~!2I! or family-non-universal U(l)' couplings [22] • Any family dependence of 
the U(l)' charges would result in FCNCs mediated by the Z' which can be suppressed 
for the first two generation and manifest themselves in rare B decays and B — B mixing 
|2*H] . In the ESSM, because the U(1)n charge assignment is flavour-independent, the 
considered model does not suffer from the FCNC problem. In the ESSM anomalies are 
cancelled in a flavour-independent way since the model contains an extra U(1)n arising 
from Eq together with the matter content of (three) complete 27 representations of Eq 
down to the TeV scale, apart from the three right-handed neutrinos which are singlets 
under the low energy gauge group. The existence of exotic supermultiplets in the ESSM 
is consistent with gauge coupling unification since the extra matter is in complete 27 rep- 
resentations. However exotic quarks and non-Higgses naturally appear in the Eq inspired 
model, with the quantum numbers of three families of 5 + 5* SU(5) representations, which 
phenomenologically correspond to three families of extra down-type quark singlets and 
three families of matter with the quantum numbers of Higgs doublets, where each mul- 
tiplet is accompanied by its conjugate representation. The large third family coupling of 
the extra coloured chiral superfields (D, D) to the singlet S of the form kS(DD) may help 
to induce radiative breakdown of the 577(2) x U(1) Y X U(l)' symmetry [20], |2*lj-|2*7j. 

Before describing the phenomenological work performed in this paper it is worth briefly 
reviewing the phenomenological studies performed so far on related models in the litera- 
ture. Recently the implications of SUSY models with an additional U(l)' gauge symmetry 
have been studied for CP-violation [2E], neutrino physics j20]~[H0], dark matter [3T], lep- 
togenesis [32], EW baryogenesis [HB] [HI], muon anomalous magnetic moment [33], electric 
dipole moment of electron [HE], lepton flavour violating processes like /i — > &-y [37] (for- 
bidding R-parity violating terms [21], [SB]). An important property of U(l)' models is 
that the tree-level mass of the lightest Higgs particle can be larger than Mz even for 
moderate values of tan/5 ~ 1 — 2 j2I] [2E], [10], hence the existing LEP bounds can be 
satisfied with almost no need for large radiative corrections. Models with a U(1)n gauge 
symmetry in which right-handed neutrinos have zero charge have been studied in [20] in 
the context of non-standard neutrino models with extra singlets, in [10] from the point 
of view of Z — Z' mixing and a discussion of the neutralino sector, in [23] where the RG 
was studied, in [22] where a one-loop Higgs mass upper bound was presented. 
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The phenomeno logical analysis presented here goes well beyond what has appeared so 
far in the literature. Our analysis begins with a detailed RG analysis of the dimensionless 
couplings in the ESSM, and an examination of the fixed points of the model. This analysis 
is completely new as it has not appeared before. We later use the results of this analysis 
in determining an upper bound on the lightest CP-even (or scalar) Higgs boson mass, 
using the effective potential and including two-loop corrections, which had also not been 
considered previously, and we make a detailed comparison with similar bounds obtained 
in the MSSM and NMSSM. We then make a comprehensive phenomenological study of 
the full Higgs spectrum and couplings, which includes the low energy allowed regions 
in which EWSB is successful, and comment on the crucial phenomenological aspects of 
the Higgs sector of the ESSM. The chargino and neutralino spectrum expected in the 
ESSM is also studied in some depth. We then discuss the phenomenology of the extra 
particles predicted by the ESSM, including the Z 1 and some exotic fermions, and provide 
a numerical estimate and a full discussion of their production cross sections and signatures 
at the upcoming CERN Large Hadron Collider (LHC) and a future International Linear 
Collider (ILC). 

The paper is organised as follows. In section 2 we specify our model. In section 3 
we examine the RG flow of gauge and Yukawa couplings assuming that gauge coupling 
unification takes place at high energies. The EWSB and Higgs phenomenology are studied 
in sections 4 and 5 respectively. In section 6 we consider the chargino and neutralino 
spectrum in the ESSM while in section 7 the potential discovery of a Z' boson and new 
exotic particles at future colliders are discussed. Our results are summarised in section 8. 



2. The ESSM 

2.1 Overview of the model 

As it is clear from the discussion in the Introduction, the ESSM is a low energy alternative 
to the MSSM or NMSSM defined as follows. The ESSM originates from an E 6 GUT gauge 
group which is broken at the GUT scale to the SM gauge group together with an additional 
U(1) N gauge group which is not broken until a scale not very far above the EW scale, 
giving rise to an observable Z' gauge boson. The U{\)n gauge group is defined such 
that right-handed neutrinos Nf carry zero charges under it. The matter content below 
the GUT scale corresponds to three 27-plets of Eq (labelled as 27j) which contain the 
three ordinary families of quarks and leptons including right-handed neutrinos Nf, three 
families of candidate Higgs doublets Hu, H 2 i, three families of extra down-type quark 
singlets Di,Di, and three families of extra singlets Si. However only the third family 
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Higgs doublets H u and Hd and singlet S develop VEVs. In addition, in order to achieve 
gauge coupling unification, there is a further pair of Higgs-like doublet supermultiplets H' 
and H' which do not develop VEVs, arising from an incomplete 27' + 27' representation. 
All the extra matter described above is expected to have mass of order the TeV scale 
and may be observable at the LHC or at an ILC The ESSM has the following desirable 
features: 

• Anomalies are cancelled generation by generation within each complete 27« repre- 
sentation. 

• Gauge coupling unification is accomplished due to the complete 27« representations 
together with the additional pair of Higgs-like doublets H' and H' from the incom- 
plete 27' + 27' representation. 

• The seesaw mechanism is facilitated due to the right-handed neutrinos Nf arising 
from the 27j representations having zero gauge charges. 

• The /i-problem of the MSSM is solved since the //-term is forbidden by the U(1)n 
gauge symmetry. It is replaced by a singlet coupling S(HdH u ) as in the NMSSM, 
but without the S 3 term of the NMSSM which resulted in domain wall problems. 
Besides, in the ESSM the would-be Goldstone boson is eaten by the Z' associated 
with the U(1)n gauge group. 

The purpose of the remainder of this section is to develop the theoretical aspects of the 
ESSM defined above, and define the matter content, charges, couplings and symmetries 
of the ESSM more precisely. 

2.2 The choice of the surviving 17(1) jv gauge group 

Since all matter and Higgs superfields must originate from 27 and 27-plets of Eq, one 
cannot break Eq in a conventional manner as the required Higgs fields are in larger 
representations than the 27. However, at the string scale, Eq can be broken via the 
Hosotani mechanism [IT] . Because the rank of the Eq group is six the breakdown of the 
Eq symmetry results in several models based on rank-5 or rank-6 gauge groups. As a 
consequence Eq inspired SUSY models in general may lead to low-energy gauge groups 
with one or two additional U(l)' factors in comparison to the SM. Indeed Eq contains 
the maximal subgroup SO (10) x U(l)^ while SO (10) can be decomposed in terms of the 
SU(5) x U(l) x subgroup. By means of the Hosotani mechanism Eq can be broken directly 
to SU(3) C x SU(2) W x U(1) Y x £7(1)^ x U(l) x which has rank 6. For suitable large VEVs 
of the symmetry breaking Higgs fields this rank-6 model can be reduced further to an 
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effective rank-5 model with only one extra gauge symmetry. Then an extra U(l)' that 
appears at low energies is a linear combination of U(l) x and U(l)^: 

U(l)' = U(l) x cos 6 + 1/(1)4, sin9. (4) 

In general the right-handed neutrinos will carry non-zero charges with respect to the 
extra gauge interaction U(l)'. It means that their mass terms are forbidden by the gauge 
symmetry. The right-handed neutrinos can gain masses only after the breakdown of 
the SU(2)w x U(l)y x U(l)' symmetry. But even in this case one can expect that the 
corresponding mass terms should be suppressed due to the invariance of the low-energy 
effective Lagrangian under the U(1)l symmetry associated with lepton number conserva- 
tion 2 . If the right-handed neutrinos were lighter than a few MeV they would be produced 
prior to big bang nucleosynthesis by the Z' interactions leading to a faster expansion rate 
of the Universe and to a higher 4 He relic abundance [12] • The current cosmological 
observations of cosmic microwave background radiation and nuclear abundances restrict 
the total effective number of extra neutrino species AN U to 0.3 [13] ■ The strength of the 
interactions of right-handed neutrinos with other particles and the equivalent number of 
additional neutrinos rises with a decreasing Z' boson mass. Thus cosmological and as- 
trophysical observations set a stringent limit on the Z' mass which has to be larger than 
4.3 TeV Q2! • 

The situation changes dramatically if the right-handed neutrinos remain sterile after 
the breakdown of the E 6 symmetry, i.e. have zero charges under the surviving gauge 
group. The extra {7(1)' factor for which right-handed neutrinos transform trivially is 
called U(1)n- It corresponds to the angle 8 = arctan y/lE in Eq. (jlj). In this case, consid- 
ered here, the right-handed neutrinos may be superheavy. Then the three known doublet 
neutrinos u e , and v T acquire small Majorana masses via the seesaw mechanism. This 
allows for a comprehensive understanding of the mass hierarchy in the lepton sector and 
neutrino oscillations data. The successful leptogenesis in the early epoch of the Universe 
is the distinctive feature of the ESSM with an extra {7(1) $ factor Because right- 
handed neutrinos are allowed to have large masses, they may decay into final states with 
lepton number L = ±1, thereby creating a lepton asymmetry in the early Universe fill . 
Since sphalerons violate B + L but conserve B — L, this lepton asymmetry subsequently 
gets converted into the present observed baryon asymmetry of the Universe through the 
EW phase transition |U] . Any other E s inspired super symmetric extension with the extra 
{7(1) factor would result in B — L violating interactions at 0(1) TeV as it is broken down 
to the SM. This B — L violating interactions together with B + L violating sphalerons 

2 In many supersymmetric models the invariance under the lepton and baryon U(l) symmetries are 
caused by R-parity conservation which is normally imposed to prevent rapid proton decay. 
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would erase any lepton or baryon asymmetry that may have been created during the ear- 
lier epoch of the Universe. Different phenomenological aspects of supersymmetric models 
with an extra U(1)n gauge symmetry were studied in [23], [211, EH], G2> Ell, [10] • 

One of the most important issues in U(l)' models is the cancellation of the gauge and 
gravitational anomalies. In Eq theories the anomalies are cancelled automatically. There- 
fore all models that are based on the Eg subgroups and contain complete representations 
should be anomaly-free. As a result in order to make the chosen supersymmetric model 
with the extra U(1)n factor anomaly-free one is forced to augment the minimal spectrum 
by a number of exotics which, together with ordinary quarks and leptons, form complete 
fundamental 27 representations of Eq. These decompose under the surviving low energy 
gauge group as discussed in the next subsection. 



2.3 The low energy matter content of the ESSM 

The three families of fundamental 27j representations decompose under the SU(b) xU(1)n 
subgroup of E 6 [23] as follows: 

27, - (10, 1), + (5*, 2\ + (5*, -3), + (5, -2), + (1, 5) 4 + (1, 0), . (5) 

The first and second quantities in the brackets are the SU(5) representation and extra 
U(1)n charge while % is a family index that runs from 1 to 3. An ordinary SM family 
which contains the doublets of left-handed quarks Qi and leptons Li, right-handed up- 
and down-type quarks (wf and df) as well as right-handed charged leptons, is assigned 
to the (10, l) i + (5*, 2) { . These representations decompose under 

SU(5) x U(1) N -> SU(3) C x SU(2) W x U(1) Y x U(1) N (6) 
to give ordinary quarks and leptons: 

(10, 1), - Q t = (u u ~ ^3, 2, 1 1 
< ~ (3*, 1, -| 1 

ei ~ (1, 1, 1, 1) ; ( 7 ) 

(5*, 2), - di ~ U\ 1, 1 2 



Li = (v h d) ~ ( 1, 2, --, 2 



2 

where the third quantity in the brackets is the U(l)y hypercharge. (In Eq. (J2J) and further 
we omit all isospin and colour indexes related to SU(2) and SU(3) gauge interactions.) 

The right-handed neutrinos N? transform trivially under SU(5) X Z7(1)jv by definition. 
Therefore N? should be associated with the last term in Eq. (JSJ) (1, 0)^. The next -to-last 
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term in Eq. ©, (1, 5) i , represents SM singlet fields Si which carry non-zero U(1)n charges 
and therefore survive down to the EW scale. 

The remaining representations in Eq. (jSJ) decompose as follows: 

1 



(5*, -3), - H U = (H U ,H^~ (l,2,- 2! 
A ~ (^3*, 1, ^ -3 

(5,-2), - F 2i = (tf+ #° ) ~ (l, 2, i -2^ 
A ~ (3, 1, -i - 

The pair of S'?7(2)-doublets (Hu and i?2i) that are contained in (5*, — 3) i and (5, — 2) i 
have the quantum numbers of Higgs doublets. Other components of these exotic £77(5) 
multiplets form extra colour triplet but EW singlet quarks and anti-quarks Di with 
electric charges —1/3 and +1/3 respectively. The exotic multiplets in Eq. (JHJ) form vector 
pairs under the SM gauge group. 

In addition to the three complete 27j representations just discussed, some components 
of additional 27' and 27' representations can and must survive to low energies, in order 
to preserve gauge coupling unification. We assume that an additional SU (2) doublet and 
anti-doublet H' and H' originate as incomplete multiplets of an additional 27' and 27'. 
Specifically we assume that they originate from the SU (2) doublet components of a (5*, 2) 
from a 27', and the corresponding anti-doublet from a 27'. 

The low energy matter content of the ESSM may then be summarised as: 

3 [(Qi, <, d\, L u e\, N?)\ + 3(5,) + 3(H 2i ) + 3(#u) + 3(A, A) +#' + #', (9) 

where the right-handed neutrinos N? are expected to gain masses at some intermediate 
scale, while the remaining matter survives down to the EW scale near which the gauge 
group U(1)n is broken. 



2.4 The low energy symmetries and couplings of the ESSM 

In Eq models the renormalisable part of the superpotential comes from the 27 x 27 x 27 
decomposition of the Eq fundamental representation. The most general renormalisable 
superpotential which is allowed by the SU(3) x SU{2) x U(l)y x U(1)n gauge symmetry 
can be written in the following form: 

Wtotal = W + W 1 + W 2 + W^. (10) 
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The first, second and third terms in Eq. (|T0j) represent the most general form of the 
superpotential allowed by the Eq symmetry. Wq, W\ and W 2 are given by 



W = XijkSiiH^Hu) + KijkSi(DjDk) + h% k NZ(H 2j L k ) + hf ]k u c t (H 2j Q k )+ 

(11) 



+h°di{H l3 Q k ) + hf ik ^(H v L k ) 



W 2 = g§^D s dr h + getfDp% + gt> k {QiLj)D h . 

The part of the superpotential (|10|1 coming from the 27 x 27 x 27 decomposition of the 
Eq fundamental representation (i.e. Wo + W\ + W 2 ) possesses a global U{1) symmetry 
that can be associated with B — L number conservation. This enlarged global symmetry 
is broken explicitly by most of the terms in Wmg. 

The last part of the superpotential (fTU|) includes the Eq violating set of terms: 

Wy = + W>+ W[ + Wi , (12) 

where 



W{ = ^fN^N c k + A k N£ + X ij S i (H lj H') + 



+g?Nf(H H') + gVuftH Q 3 ) + //,,(//.;/.,) + ^(H 2l H') + , 
W^gS'iQiH^Dj, i,j,k — 1,2,3. 



(13) 



The terms in Eq. (I12|) are invariant with respect to the SM gauge group and extra U(1)n 
transformations but are either forbidden by the Eq symmetry itself or by the splitting of 
complete 27 and 27 representations that also breaks Eq. Some of the interactions listed 
in Eq. (|12p can play a crucial role in low-energy phenomenology. For example, Majorana 
mass terms of the right-handed neutrinos at some intermediate scales provide small Ma- 
jorana masses for the three species of left-handed neutrinos via the seesaw mechanism. 
Some other terms in Eqs. (JEjHjEl) (like iiijH 2i Lj) may be potentially dangerous from 
the phenomenological point of view. 

Although the B — L number is conserved automatically in Eq inspired SUSY models, 
some Yukawa interactions in Eq. (jlljl violate baryon number resulting in rapid proton 
decay. The baryon and lepton number violating operators can be suppressed by postulat- 
ing the invariance of the Lagrangian under R-parity transformations. In the MSSM the 
R-parity quantum numbers are 

R = (-iy( B - L )+* s . (14) 
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The straightforward generalisation of the definition of R-parity to Eq inspired super- 
symmetric models, assuming Bo = 1/3 and Bjy = —1/3, implies that W\ and W 2 are 
forbidden by the discrete symmetry (fTlj) . In this case the rest of the Lagrangian of the 
considered model, which is allowed by the E G symmetry, is invariant not only with respect 
to U{1)l and U{1)b but also under U{l)o symmetry transformations 3 

D^e ia D, D^e- ia D. (15) 

The U(1)d invariance ensures that the lightest exotic quark is stable. Any heavy 
stable particle would have been copiously produced during the very early epochs of the 
Big Bang. Those strong or electromagnetically interacting fermions and bosons which 
survive annihilation would subsequently have been confined in heavy hadrons which would 
annihilate further. The remaining heavy hadrons originating from the Big Bang should 
be present in terrestrial matter. There are very strong upper limits on the abundances 
of nuclear isotopes which contain such stable relics in the mass range from 1 GeV to 
lOTeV. Different experiments set limits on their relative concentrations from 10~ 15 to 
10 -30 per nucleon |46j . At the same time various theoretical estimations [37] show that 
if remnant particles would exist in nature today their concentration is expected to be at 
the level of 10 -10 per nucleon. Therefore Eq inspired models with stable exotic quarks or 
non-Higgsinos are ruled out. 

To prevent rapid proton decay in E 6 supersymmetric models the definition of R-parity 

should be modified. There are 8 different ways to impose an appropriate Z 2 symmetry 

resulting in baryon and lepton number conservation |3H]- The requirements of successful 

leptogenesis and non-zero neutrino masses single out only two ways to do that. If Hu, H 2 i, 

Si, Di, Di and quark superfields (Qi, u\, df) are even under Z 2 while lepton superfields 

(Lj, e\, Nf) and survival components of 27 and 27 (H' and H') are odd, all terms in 

W 2 are forbidden. Then the part of the superpotential allowed by the E§ symmetry is 

invariant with respect to U(1)b and U(1)l global symmetries if the exotic quarks Di and 

Di carry twice larger baryon number than the ordinary quark fields di and Qi respectively. 

It implies that Di and Di are diquark and anti-diquark, i.e. Bp = —2/3 and Bjy = 2/3. 

This way of suppressing baryon and lepton number violating operators will be called 

further Model I. An alternative possibility is to assume that the exotic quarks Di and Di 

as well as ordinary lepton superfields and survivors are all odd under Z 2 whereas the others 

remain even. Then we get Model II in which all Yukawa interactions in W\ are ruled out 

by the discrete Z 2 symmetry. Model II possesses two extra U(l) global symmetries. They 

can be associated with U(1)l and U(1)b if the exotic quarks carry baryon {Bo = 1/3 and 

3 The term ^Didj in Wp/ spoils the invariance under U(1)d symmetry but the mechanism of its 
generation remains unclear. 
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B-jy = —1/3) and lepton (Lp = 1 and Ljj = —1) numbers simultaneously. It means that 
Di and Di are leptoquarks in Model II. 

In Model II the imposed Z 2 symmetry forbids all the terms in the W[ part of W^r, 
leaving only the mass terms for the right-handed neutrinos, Wq and W 2 . The discrete 
symmetry postulated in the Model I also rules out W 2 but permits /I'^Dtd^ which violate 
baryon number making possible the transition p — > tt + x°, where x° is a neutralino. In 
order to suppress dangerous operators one can impose another Z 2 symmetry that changes 
the sign of the ordinary quark superfields Qi, u^, di leaving all others unchanged. Finally 
for the superpotentials of Model I and II we get 

/) WW* i = w + w 1 + \m 1] n^n , t + w^ 

I (16) 
II) WWdii = W + W 2 + -M ij N^ + W^ + W^. 

2.5 Origin of bilinear mass terms in the ESSM 

In the superpotentials (jTSj) the non-Higgs doublets and the survival components from 
the 27' can be redefined in such a way that only one SU(2) doublet H' interacts with 
the H from the 27'. As a result without loss of generality in Wq may be set to 
zero. Then the superpotentials of the considered supersymmetric models include two 
types of bilinear terms only. One of them, -MijN^Nj, determines the spectrum of the 
right-handed neutrinos which are expected to be heavy so that the corresponding mass 
parameters My are at intermediate mass scales. Another one, fi'H'H , is characterised by 
the mass parameter // which should not be too large otherwise it spoils gauge coupling 
unification in the ESSM. On the other hand, the parameter /i cannot be too small since 
jji'H'H is solely responsible for the mass of the charged and neutral components of H' . 
Therefore we typically require fi' ~ 0(1 TeV) as in the MSSM, potentially giving rise to 
the n problem once again. 

Within SUGRA models the appropriate term n'H'H' in the superpotentials (fTBj) can 
be induced just after the breakdown of local SUSY if the Kahler potential contains an 
extra term (Z(H'H ) + h.c) [IHj. This mechanism is of course just the same one used in 
the MSSM to solve the fi problem. But in superstring inspired models the bilinear terms 
involving and H u are forbidden by the E 6 symmetry both in the Kahler potential and 
superpotential. As a result the mechanism mentioned above cannot be applied for the 
generation of fiHdH u in the ESSM superpotential. However this mechanism may be used 
to give mass to the non-Higgs doublets H' and H from additional 27' and 27' since the 
corresponding bilinear terms are allowed by the E G symmetry both in the Kahler potential 
and superpotential. 
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The other bilinear terms in the superpotential of the E$ inspired SUSY models respon- 
sible for right-handed neutrino masses can be induced through the non-renormalisable 

interactions of 27 and 27 of the form (27 a 27 ' pf '. If the iVj^ and N° H components 

Mpi 

of some extra 27h and 27h representations develop VEVs along the .D-flat direction 
< N 1 ^ >=< N C H > the original gauge symmetry of the rank-6 superstring inspired model 
with extra U(l)^ and U(l) x reduces to SU(3) C x SU(2) W x U(1) Y x U(1) N . In this case 
the effective mass terms for the right-handed neutrinos are generated automatically if the 
extra 27^-plet couples to the ordinary matter representations 

5W = -^(27 H 27 t )(T H 27 J ) =► M {j = ^ < N° H > 2 . (17) 

Mpi Mpi 

To get a reasonable pattern for the left-handed neutrino masses and mixing the U(l)^ 
and U(l) x gauge symmetries should be broken down to the U(1)n one around the Grand 
Unification or Planck scale. A similar mechanism could be applied for the generation 
of the fi term discussed earlier. However it is rather difficult to use the same fields iVJj 
and N C H in both cases because the values of the corresponding mass parameters are too 
different. In order to obtain /x in the TeV range one should assume the existence of 
additional pair of Nfa and N H which acquire VEVs of order 10 11 GeV. 

2.6 Yukawa couplings in the ESSM 

The superpotential ()16|) of the ESSM involves a lot of new Yukawa couplings in com- 
parison to the SM. But only large Yukawa couplings are significant for the study of the 
renormalisation group flow and spectrum of new particles which will be analysed in the 
subsequent sections. The observed mass hierarchy of quarks and charged leptons implies 
that most of the Yukawa couplings in the SM and MSSM are small. Therefore it is 
natural to assume some hierarchical structure of the Yukawa interactions of new exotic 
particles with ordinary quarks and leptons as well. As discussed earlier, without loss of 
generality we can assume that only the third family Higgs doublets and singlets S = S3, 
Ha = Hi 3 , H u = H 2 3 gain VEVs, and furthermore the third family Higgs sector couples 
most strongly with the third family quarks and leptons. The third family SM singlet field 
S will also couple to the exotic quarks Di and Di and SU (2) non-Higgs doublets Hi a and 
H 2a {a = 1,2). 

Discrete and extended gauge symmetries, which were specified before, do not guarantee 
the absence of FCNCs in the ESSM. Indeed the considered model contains many SU(2) 
doublets and exotic quarks which interact with ordinary quarks and charged leptons of 
different generations. Therefore one may expect that even in the basis of their mass 
eigenstates the non-diagonal flavour transitions are not forbidden. For example, non- 
diagonal flavour interactions contribute to the amplitude of K° — 1{° oscillations and 
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give rise to new channels of muon decay like /i — ► e~e + e _ . To suppress flavour changing 
processes one can postulate Z% symmetry. If all superfields except H u , Ha and S are 
odd under Z^ symmetry transformations then only one Higgs doublet interacts with 
the down-type quarks and charged leptons and only one Higgs doublet H u couples to 
up-type quarks while the couplings of all other exotic particles to the ordinary quarks 
and leptons are forbidden. This eliminates any problems related with the non-diagonal 
flavour transitions in the considered model. 

The most general Z^ and gauge invariant part of the ESSM superpotential that de- 
scribes the interactions of the SM singlet fields S% with exotic quarks, SU(2) Higgs and 
non-Higgs doublets can be written as 

KjkSi{HijH2k) + KijkSi(DjDk) ► \iS\HuH2i) + KiS{D i Di) J r 

(18) 

where a, (3 = 1,2 and i — 1, 2, 3 . In Eq. (fT%|) we choose the basis of non-Higgs and exotic 
quark superfields so that the Yukawa couplings of the singlet field S have flavour diagonal 
structure. Here we define A = A3 and k = k 3 4 . If A or k are large at the Grand Unification 
scale they affect the evolution of the soft scalar mass m| of the singlet field S rather 
strongly resulting in negative values of m| at low energies that triggers the breakdown 
of U(1)n symmetry. The singlet VEV must be large enough to generate sufficiently large 
masses for the exotic particles to avoid conflict with direct particle searches at present 
and former accelerators. This also implies that the Yukawa couplings Aj and /tj (i 7^ 3) 
involving the new exotic particles although small must be large enough. The Yukawa 
couplings of other SM singlets f a p and f a p are expected to be considerably less than Aj 
and Ki to ensure that only one singlet field S gains a VEV. At the same time f a p and f a/ 3 
cannot be negligibly small because in this case the fermion components of superfields Si 
and 5*2 becomes extremely light 5 . The induced masses of singlinos S\ and 62 should be 
larger a few MeV otherwise the extra states could contribute to the expansion rate prior 
to nucleosynthesis changing nuclear abundances. 

The Z2 symmetry discussed above forbids all terms in W\ and W% that would allow 
the exotic quarks to decay. Therefore discrete Z2 symmetry can only be approximate. 
In our model we allow only the third family SU (2) doublets Hd and H u to have Yukawa 
couplings to the ordinary quarks and leptons of the order unity. As discussed, this is a 
self-consistent assumption since the large Yukawa couplings of the third generation (in 

4 Note that k as defined here in the ESSM refers to the coupling of the singlet S to the third family 
exotic quarks DD, and is not related to the k of the NMSSM which refers to the cubic singlet coupling 
S 3 which is absent in the ESSM. 

5 When f a fs and f a p vanish singlinos Si and S2 remain massless. 
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particular, the top-quark Yukawa coupling) provides a radiative mechanism for generating 
the Higgs VEVs [SD] which defines the third family direction. As a consequence the neutral 
components of H u and H d acquire non-zero VEVs inducing the masses of ordinary quarks 
and leptons. The Yukawa couplings of two other pairs of SU(2) doublets Hu and H 2i 
as well as H' and exotic quarks to the quarks and leptons of the third generation are 
supposed to be significantly smaller (< 0.1) so that none of the other exotic bosons 
gain a VEV. These couplings break Z 2 symmetry explicitly resulting in flavour changing 
neutral currents. In order to suppress the contribution of new particles and interactions 
to the K° — K° oscillations and to the muon decay channel [i — > e~e + e~ in accordance 
with experimental limits, it is necessary to assume that the Yukawa couplings of exotic 
particles to the quarks of the first and second generations are less than 10 -4 and their 
couplings to the leptons of the first two generations are smaller than 10 -3 . 

3. Renormalisation group analysis 

3.1 The approximate superpotential to be studied 

Following the discussion about the natural choice of the parameters in our model given 
at the end of section 2, we can now specify the superpotential couplings whose RG flow 
will be analysed in this section. In our RG analysis we shall retain only Yukawa couplings 
which appear on the right-hand side of Eq. (fTK|) . together with the 0(1) Yukawa couplings 
to the quarks and leptons. We shall neglect the neutrino Yukawa couplings as well as the 
small couplings involving the first and second family singlets in our analysis. Then the 
approximate superpotential studied is given by: 

Wo « XS(H d H u ) + XxSiHx^) + X 2 S(H lj2 H 2 , 2 ) + kS(D 3 D 3 )+ 

(19) 

+«iS , (D 1 D 1 ) + k 2 S{D 2 D 2 ) + h t (H u Q)t c + h b (H d Q)b c + h T (H d L)r c , 

where all ordinary quark and lepton superfields appeared in Eq. ()19j) belong to the third 
generation, i.e. L = L 3 , Q = Q 3 , t c = u 3 , b c = c?g and r c = e 3 . Here we adopt the 
notation A = A3 and k = k 3 . The obtained superpotential possesses the approximate 
Z 2 symmetry specified in the previous section which ensures the natural suppression of 
FCNCs. To guarantee that only one pair of SU (2) doublets H u and H d acquires a VEV 
we impose a certain hierarchy between the couplings of Hu and H 2 i to the SM singlet 
superfield 5*: A > Ai 2 - We assume further that the superpotential (|T9*j) is formed near 
the Grand Unification or Planck scale. But in order to compute the masses and couplings 
at the EW scale one has to determine the values of gauge and Yukawa couplings at the 
EW scale. The evolution of all masses and couplings from Mx to Mz is described by a 
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system of RG equations. In this section we study the behaviour of the solutions to such 
equations describing the gauge and Yukawa couplings in the framework of the ESSM. 

3.2 The mixing of U(1) Y and U(1) N 

In this subsection we address a mixing phenomenon related with the gauge sector of 
models containing two U(l) gauge factors. In the Lagrangian of any gauge extension 
of the SM containing an additional U(l)' gauge group there can appear a kinetic term 
consistent with all symmetries which mixes the gauge fields of the U(l)' and U(l)y [51. 
Our model is not an exception in this respect. In the basis in which the interactions 
between gauge and matter fields have the canonical form, i.e. for instance a covariant 
derivative which acts on the scalar and fermion components of the left-handed quark 
superfield given by 

D M = d, - ig 3 Ap« - ig 2 Wy - igyQjBl - ig N Q? B* , (20) 

the pure gauge kinetic part of the Lagrangian can be written as 

4*. = ~\ {Flf - \ K) 2 - % ^FlF% - \ (G, v f - \ (W, v f . (21) 

In Eqs. flUI)-(I2Il) A°, W*, Bl and B^ represent SU(3), SU{2), U(l)y and U{1) N gauge 
fields, G a , W^ u , Fj u and F^ v are field strengths for the corresponding gauge interactions, 
while #3, g 2 , 9y and g^ are SU(3), SU(2), U(l)y and U(1)n gauge couplings respectively. 

Because U{l)y and U(1)n arise from the breaking of the simple gauge group Eq the 
parameter sin \ that parametrises the gauge kinetic term mixing is equal to zero at tree- 
level. However it arises from loop effects since 

Tr(Q Y Q N )= £ {QYQ?)*0- (22) 

i= chiral fields 

Here the trace is restricted to the states lighter than the energy scale being considered. 
The complete Eq multiplets do not contribute to this trace. Its non-zero value is due to 
the incomplete 27' + 27' multiplets of the original Eq symmetry from which only H' and 
H' survive to low energy in order to ensure gauge coupling unification. 

The mixing in the gauge kinetic part of the Lagrangian (|21jl can be easily eliminated 
by means of a non-unitary transformation of the two U(l) gauge fields [2H]> [S^j |53j: 

B* = B lfl -B 2ll taiix, Bf L =B 2 Jcos X . (23) 

In terms of the new gauge variables B\^ and B 2fl the gauge kinetic part of the Lagrangian 
(121)1 is now diagonal and the covariant derivative (|2()jl becomes [SQ 

D, = d, - ig 3 A;T a - ig 2 Wy - i 9l QjB lfl - i(g[Q» + g u Qj)B 2fl , (24) 
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where the redefined gauge coupling constants, written in terms of the original ones, are 
9i=9y, g[=g N /cosx, #11 = -fly tan % ■ (25) 

In the new Lagrangian written in terms of the new gauge variables and B 2fl (defined 
in Eq. ([23))) the mixing effect is concealed in the interaction between the U(1)n gauge 
field and matter fields. The gauge coupling constant g[ is varied from the original one 
and also a new off-diagonal gauge coupling gn appears. The covariant derivative (|2"%|) 
can be rewritten in a more compact form 

D, = d,- ig 3 AlT a - ig 2 Wy - iQ T GB, , (26) 

where Q T = (Qf , Qf), B'F = (-B 1(U , £? 2At ) and G is a 2 x 2 matrix of new gauge couplings 

G=[ . (27) 

V fll J 

Now all physical phenomena can be considered by using this new Lagrangian with the 
modified structure of the extra U(1)n interaction (j24|) - (|26|) . In the considered approx- 
imation the gauge kinetic mixing changes effectively the U(1)n charges of the fields to 



Qi = Q«+Qf5, (28) 

where 5 = gn/g[ while the U(l)y charges remain the same. As the gauge coupling 
constants are scale dependent, the effective U(1)n charges defined here as Qi are scale 
dependent as well. The particle spectrum now depends on the effective U(1)n charges 

Qi- 

In Eq. (|28|) the correct Eq normalisation of the charges should be used, and thus the 



U(1)y hypercharges in Eqs. should be multiplied by a factor y jj, and the Q N 



charges in Eqs. (|7jl-(|5]l should be multiplied by l/v40. The correctly normalised charges 
of all the matter fields in the ESSM are summarised in Tabled The charges are family 
independent, and the index i here refers to the different multiplets as well as the different 
families. 

3.3 The running of the gauge couplings 

At the one-loop level the full set of RG equations describing the running of gauge and 
Yukawa couplings splits into two parts. One of them includes RG equations for the gauge 
couplings. In the one-loop approximation (3 functions of the gauge couplings do not 
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Table 1: The U(l)y and U(1)n charges of matter fields in the ESSM, where and are here defined 
with the correct Eq normalisation factor required for the RG analysis. 



depend on the Yukawa ones. Therefore this part of the system of RG equations can be 
analysed separately, and is discussed in this subsection. 

The RG flow of the Abelian gauge couplings is affected by the kinetic term mixing 
as discussed in the previous subsection. Using the matrix notation for the structure of 
U(l) interactions with G defined in Eq. (J27|) one can write down the RG equations for 
the Abelian couplings in a compact form j26j . |o^] |53j 
An 

^ = GxB, (29) 
where B is a 2 x 2 matrix of (3 functions given by 

B _ ( Bl Bn \ _ 1 ( ^ 29l9 ^ n + 2 9i9nPi \ 
~ V B[ ) ~ ( 47r ) 2 \ g^[ + 2g' l g 11 p ll +gl l p 1 ) ' 

In the ESSM with N g = 3 the one-loop (3 functions j3\, (3[ and (3u are 

a = £(gf) 2 = f , # = E(^) 2 = f . Ai = E ^gf = .(31) 

j j j 

The index i is summed over all possible chiral superfields and all families. Note that 
P 1 ps ^> /3u. This implies that the effect of U(l) gauge mixing is ultimately rather 
small, and furthemore that, if the (properly normalised) gy and start out equal at the 
GUT scale, then they will remain approximately equal at low energies. 

The running of SU(2) and SU(3) couplings obey the RG equations of the standard 
form: 

d92 P29I dg 3 fyg% 



dt (4tt) 2 ' dt (4tt) 

with (3 functions 



(32) 



(3 2 = -5 + 3N g , = -9 + 3N g , (33) 

where t = In (ju/Mj) and /i is the RG scale. The parameter N g appeared in the expressions 
for fa and fa is the number of generations forming Eq fundamental representations which 
the considered SUSY model involves at low energies. As one can easily see from Eq. (}3*3*j) 
N g = 3 is the critical value for the one-loop (3 function of strong interactions. Since by 
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construction three complete 27-plets survive to low energies in the ESSM (3% is equal to 
zero in our case and SU(3) gauge coupling remains constant everywhere from Mz to M x . 
Because complete 27-plets do not violate E 6 symmetry each generation should give the 
same contribution to all (3 functions. It takes place automatically in the case of SU(2) 
and SU(3) (3 functions and allows to obtain a correct normalisation for the charges of two 
Z7(l)'s. 

The RG equations for the gauge couplings in Eqs. (|2*9*|l and (|52~j) should be supple- 
mented by the boundary conditions. Since we deal with an E§ inspired model it seems 
to be natural to assume that at high energies E$ symmetry is restored and all gauge 
interactions are characterised by a unique Eq gauge coupling go which is defined as 

g 3 (M x ) = g 2 {M x ) = g x {M x ) = g[(M x ) = g . (34) 

Also we expect that there is no mixing in the gauge kinetic part of the Lagrangian just 
after the breakdown of the Eg symmetry, i.e. 

g n (M x ) = Q. (35) 



The hypothesis of gauge coupling unification (jMj) permits to evaluate the overall gauge 
coupling g and the Grand Unification scale M x using the values of gi(M z ), g-i{Mz) 
and gz(Mz) which are fixed by LEP measurements and other experimental data |5lj . 
The high energy scale where the unification of the gauge couplings takes place is almost 
insensitive to the matter content of the supersymmetric model. Indeed, in the one-loop 
approximation we have 

Mi 



(4tt)2 M| (3 l -f3 2 



(36) 



U?(Mf) g\{Ml)\ ■ 

Because the dependence of the scale M x , where U(l)y and SU(2) gauge couplings meet, 
on the particle content of any model comes from the difference of the corresponding j3 
functions, in which the contribution of any complete £77(5) multiplets is cancelled, the 
Grand Unification scale in the ESSM remains the same as in the MSSM, i.e in the one- 
loop approximation M x ~ 2 • 10 16 GeV. At the same time the value of the overall gauge 
coupling is rather sensitive to the matter content of SUSY models. In the ESSM the 
appropriate values of the SU(2), ££7(3) and U(l)y gauge couplings at the EW scale can 
be reproduced for g ~ 1.21 which differs from the value of go ~ 0.72 found in the minimal 
SUSY model. The growth of go in our model is caused by the extra exotic supermultiplets 
of matter. 

The interesting point concerning the matter content in our model is that (3i, f3[, (3 2 
and /?3 are quite close to their saturation limits when the gauge couplings blow up at the 
Grand Unification scale. The ESSM allows to accommodate only one additional pair of 
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5 + 5 representations of the usual SU (5) which form extra exotic quark and non-Higgs 
multiplets. Further enlargement of the particle content leads to the appearance of the 
Landau pole during the evolution of the gauge couplings from Mz to Mx- 

Using the boundary conditions (JMj) and (J3l)j) as well as the obtained values of go and 
Mx it is possible to solve the RG equations for g[ and gn. It turns out that g[(Q) is very- 
close to gi{Q) for any value of renormalisation scale Q from Mx to Mz while gn{Q) is 
negligibly small compared to all other gauge couplings. At the EW scale we get 

9 4r^\ -0.99, gxx{M z )~ 0.020, 9l (M z )~0A6. (37) 

9i{M z ) 

Eq. (|3T|) tells us that if the (properly normalised) gy and g^ couplings start out equal 
at the GUT scale, then they will remain approximately equal at low energies to within 
an accuracy of two per cent at the one-loop level. As previously noted, this results from 
flx ~ 0[ ^> flu which implies that the effect of U(l) gauge mixing is small. In the 
following analysis we shall continue to include the effects of U(l) gauge mixing in the 
correct way. However, it should be noted that to excellent approximation we could take 
9x — 9i — 9y — 9n an d Qi = Qf, which is within the accuracy of the one-loop result. 



3.4 The running of the Yukawa couplings 



The running of the Yukawa couplings appearing in the superpotential in Eq. ()19j) obey 
the following system of differential equations 6 : 
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A 2 + 6h 2 +h 2 b - jg 2 3 - 3g\ - ^g 2 _ 2 (Qi + Q 2 Q + Q 2 ) , /V 
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\ +h t + 6h z b + K- -gi - 3g 2 2 - -gf - 2 [Q{ + Q Z Q + Q z d ) 9l 



15' 
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\' + 3hl + 4K-3gi-~g(-2 [Qi+ Q' L + Qi) g{ 



2X 2 + 2S A + 3S K + (3h 2 t + 3h 2 + h 2 T )5, 



gt-2[Q 2 s + Qi + Qi )9x 



16 2 4 2 



2k\ + 2S A + 3S K - —gi - g f-2(Q 2 s + Q 2 D + g { 



'2 



3" J 15' 

where £ A = A 2 + X 2 , + A| and S K = n\ + k 2 , + k 2 and where the index i = 1, 2, 3. 

The couplings h t , and h T in Eq. (}3*Hj) determine the running masses of the fermions 
of the third generation at the EW scale 



m t (M t ) = ht{A ^ )V sin /3, m b (M t ) 
Vf 

5 See also [2S]-|2E1 



cos p, m T (M t ) = -= — cos p ,(39) 



V2 



V2 
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which are generated after EWSB. In Eq. ()39)1 m T , rrit and m& are the running masses 
of the r-lepton, top- and bottom-quark respectively, M t is a top quark pole mass, 
v = -\fv\ + v 2 = 246 GeV, while tan/5 = v 2 /vi, where v 2 and v± are the VEVs of the 
Higgs doublets H u and H^. Since the running masses of the fermions of the third gen- 
eration are known, Eq. (}39|) can be used to derive the Yukawa couplings h T (M t ), h t (M t ) 
and hb(M t ) for each particular value of tan/3 establishing boundary conditions for the 
renormalisation group equations (|38|). In this paper we restrict our analysis to moderate 
values of tan/3 <C m t (M t ) / irib{M t ) for which 6-quark and r-lepton Yukawa couplings are 
much smaller than ht and thus can be safely neglected. 

The boundary conditions for the Yukawa couplings of the SM singlet field S to the 
Higgs doublets and exotic particles are unknown. These couplings give rise to the masses of 
the exotic quarks and non-Higgsinos after the breakdown of gauge symmetry. Since none 
of the exotic particles or Higgs bosons have been found yet X. t and Ki should be considered 
as free parameters in our model. There are two different assumptions regarding these 
couplings that look rather natural and allow one to reduce the number of new parameters. 
One of them implies that the masses of the exotic particles mimic the hierarchy observed 
in the sector of ordinary quarks and charged leptons. Then non-observation of new exotic 
states may be related with the considerable hierarchy of VEVs of the singlet field S and 
Higgs doublets. In this case Ai, A2, «i and n 2 are tiny and can be simply ignored. 

Although the suggested pattern is quite simple and natural it does not permit to tell 
anything about the masses of the exotic particles of the first two generations because the 
corresponding Yukawa couplings are set to zero from the beginning. In the meantime 
one has to ensure that exotic fermions gain large enough masses to avoid any conflict 
with direct new particle searches at present and former colliders. Therefore it is worth 
to incorporate all Yukawa couplings of exotic particles to the SM singlet field S in our 
analysis of RG flow. Because the Yukawa interactions of extra coloured singlets Di and 
Di in the superpotential (fTU|) and as a consequence the corresponding RG equations are 
symmetric with respect to the generation index % exchange, i.e. 1 <-» 2, 2 <-> 3 and 3 <-> 1, 
there is a solution of the RG equations when all K{ are equal to each other. Moreover the 
solutions for Ki(Q) tend to converge to each other during the evolution of these couplings 
from the Grand Unification to EW scale. Thus the choice Ki(M t ) = K 2 (M t ) = n(M t ) is 
well motivated by the RG flow. 

Similar results can be obtained for Ai and A2. However the running of Xi(Q) = X 2 (Q) 
differs from the evolution of X(Q) because the top-quark and its superpartners give sig- 
nificant contributions to the renormalisation of \(Q). Nevertheless the difference between 
the RG flow of Xi(Q) = X 2 (Q) and X(Q) is not so appreciable in comparison with the 
running of Ki(Q) and h t (Q). The couplings of the Yukawa interactions involving quark 
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superfields renormalise by virtue of the strong interactions that push their values up con- 
siderably at low energies. Therefore it seems to be reasonable to ignore the difference 
between the evolution of \{Q) in first approximation and consider separately the limit 
in which \ 1 {M t ) = \ 2 {M t ) = X(M t ). 

At first we consider the limit when the Yukawa couplings of the exotic quarks and 
non-Higgses of the first two generation are negligibly small. Then the system of the RG 
equations can be rewritten in the suggestive form 



o 2 d 
87T — 

dt 



o 2 d 
87T — 

dt 



A 2 
hi 
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If we ignore gauge couplings the system of differential equations (pfUj) has two fixed points 



m 5 =1 ' l =o; 

(41) 

A 2 k 2 6 

(//) 5? = ' 5? = 5- 

Of these fixed points only the last one is infrared stable. The presence of the infrared 
stable fixed point (II) means that if we start with random boundary conditions for the 
couplings A, k and h t in the gaugeless (g = 0) limit the solutions of the RG equations 
()40|) tend to converge towards the values which respect the ratios (//). This is illustrated 
in Fig. la where the running X/ht versus n/h t for ht(Mx) = 10, go = and regular 
distribution of boundary conditions for X(Mx) and k(Mx) at the Grand Unification scale 
is shown. A point in the plane X/h t — n/h t will flow rapidly towards the valley, that 
corresponds to the invariant line which connects fixed points (/) and (//), and then more 
slowly along it to the stable fixed point (//). The properties of invariant lines and surfaces 
were reviewed in detail in [EH] . 

So far we have neglected the effects of gauge couplings. However their role is quite 
important especially at low energies where the gauge coupling of the strong interactions is 
larger than the Yukawa ones. As one can see from Fig. lb the inclusion of gauge couplings 
spoils the valley along which the solutions of RG equations flow to the fixed points (//). 
But the convergence of h t (Q), X(Q) and k(Q) to the quasi-fixed point, which becomes 
more close to unity, increases. 
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Similar analysis can be performed in the case when all Yukawa couplings of exotic 
particles have non-zero values. As before in the gaugeless limit there is only one stable 
fixed point of the RG equations (EBt which corresponds to 



' h\~ h\ ~ h\ "5- (42) 

Turning the gauge couplings on induces a certain hierarchy between the Yukawa couplings 
of exotic quarks and non-Higgses. Due to the growth of the gauge coupling of strong 
interactions at low energies the Yukawa couplings of the top- and exotic quarks tend to 
dominate over \. It shifts the position of the quasi-fixed point where the solutions of the 
RG equations are focused 

In spite of their attractiveness fixed points cannot provide a complete description of 
the RG flow of Yukawa couplings. Indeed, the strength of the attraction of the solutions to 
the RG equations (j41j) towards the invariant line and fixed point is governed by h t (Mx)- 
The larger h t (Mx) the faster the stable fixed point is reached. However at small values 
of ht(Mx) = 0.2 — 0.4 the convergence of h t (Q), X(Q) and k(Q) to the fixed points is 
extremely weak. Therefore even at moderate values of tan/5 = 1.5 — 3 the values of the 
Yukawa couplings at the EW scale may be far away from the stable fixed point. 

In this context it is worth to study the limits on the values of the Yukawa couplings 
imposed by the perturbative RG flow. The growth of Yukawa couplings at the EW scale 
entails the increase of their values at the Grand Unification scale resulting in the appear- 
ance of the Landau pole. Large values of the Yukawa couplings spoil the applicability of 
perturbation theory at high energies so that the one-loop RG equations cannot be used 
for an adequate description of the evolution of gauge and Yukawa couplings at high scales 
Q ~ Mx ■ The requirement of validity of perturbation theory up to the Grand Unification 
scale restricts the interval of variations of Yukawa couplings at the EW scale. In the 
simplest case when K\ = n 2 = Ai = A 2 = the assumption that perturbative physics 
continues up to the scale Mx sets an upper limit on the low energy value of n(M t ), 
evaluated at the top mass M t , for each fixed set of \(M t ) and ht(M t ) (or tan/?). With 
decreasing (increasing) X(M t ) the maximal possible value of K(M t ), which is consistent 
with perturbative gauge coupling unification, increases (decreases) forming a demarcating 
line that restricts the allowed range of the parameter space in the n/h t — X/h t plane for 
each particular value of tan /3. 

For tan (3 = 2 the corresponding limits on the low energy Yukawa couplings evaluated 
at M t are shown in Fig. 2a. Outside the permitted region the solutions of the RG equations 
blow up before the Grand Unification scale and perturbation theory is not valid at high 
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energies. The allowed range for the Yukawa couplings varies when tan (3 changes. When 
tan (3 tends to its lower bound caused by the applicability of perturbation theory, which 
is around unity in our model, the permitted part of the parameter space narrows in the 
direction of X/h t so that only a small interval of variations of X/h t is allowed. At large 
tan f3 the allowed range for the Yukawa couplings enlarges. The typical pattern of the 
RG flow of the ratios of Yukawa couplings from the permitted region of the parameter 
space is presented in Fig. 2b. It differs significantly from the analogous pattern obtained 
in the top-bottom approach (see Fig. 1) because the chosen value of top-quark Yukawa 
coupling, which corresponds to tan/3 = 2, is quite far from the quasi-fixed point. The 
peculiar feature of both patterns is that the ratio of X/h t changes during the evolution 
more strongly than n/h t . Owing to this most trajectories in Fig. 2b are almost parallel 
to the axis X/h t . 

A similar pattern for the RG flow can be found for most values of tan/3 and does 
not change much after the inclusion of the Yukawa couplings of exotic particles of the 
first two generations. But the introduction of K\, K2, Ai and A2 makes more rigorous the 
restrictions on the Yukawa couplings of the third generation. In Fig. 2c we plot the allowed 
range of the Yukawa couplings in the case when Ai and A2 are still negligibly small while 
K = Ki = K2- It is easy to see that in this case the upper bounds on njht are more stringent 
than in Fig. 2a. Turning Ai and A 2 on so that X(M t ) = Xi(M t ) = A 2 (M 4 ) reduces the 
limit on X/h t (see Fig. 2d). The narrowing of the allowed range of the parameter space 
is not an unexpected effect. New Yukawa couplings appear in the right-hand side of 
the differential equations with positive sign. As a consequence they increase the 
growth of the Yukawa couplings of the third generation and perturbation theory becomes 
inapplicable for lower values of X(M t ) and k(M 4 ). 

Because the allowed range of the Yukawa couplings always shrinks when additional 
Yukawa couplings are introduced one can find an absolute upper limit on the value of 
X(M t ) as function of h t (M t ) or tan/5 by setting all other Yukawa couplings to zero. The 
dependence of this upper limit A max on tan (3 is shown in Fig. 3. The upper bound on X(M t ) 
grows with increasing tan (3 because the top-quark Yukawa coupling decreases. The value 
of A max vanishes at tan (3 ~ 1 when the top-quark Yukawa coupling attains a fixed point 
(see also Fig. lb). At large tan/5 the upper bound on X(M t ) approaches the saturation 
limit where A max ~ 0.84. The restrictions on X(M t ) and other Yukawa couplings obtained 
in this section are extremely useful for the analysis of the Higgs particle spectrum which 
we are going to consider next. 
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4. Electroweak symmetry breaking and Higgs sector 



4.1 The Higgs potential and its minimisation 

The sector responsible for EWSB in the ESSM includes two Higgs doublets H u and H d 
as well as the SM singlet field S. The interactions between them are defined by the 
structure of the gauge interactions and by the superpotential in Eq. (jTHj) . Including soft 
SUSY breaking terms, and radiative corrections, the resulting Higgs effective potential is 
the sum of four pieces: 

V = V F + V D + V soft + A V , 

V F = \ 2 \S\ 2 (\H d \ 2 + \H u \ 2 ) + \ 2 \(H d H u )\ 2 , 



2 / vJ 

2\ 2 



V D = ^(H d a a H d + Hla a H u ^ + ^- {\H d \ 2 - \H U \ 2 ) 

'2 

(gi|^i 2 + g 2 |^r + g 5 |5| 2 



(44) 



V m ft = m 2 \S\ 2 + m 2 \H d \ 2 + m 2 \H u \ 2 + 



XA x S(H u H d ) + h.c. 



where g' = \/3/5<7i is the low energy (non-GUT normalised) gauge coupling and Qi, Q2 
and are effective Z7(l)jv charges of if^, H u and S respectively Here Hj = (H®, H~[), 
El = (H+, Hi) and (H d H u ) = H+H d - H®H%. At tree-level the Higgs potential in 
Eq. (}4*4"|) is described by the sum of the first three terms. The structure of the F-terms Vp 
is exactly the same as in the NMSSM without the self-interaction of the singlet superfield. 
However the D-terms in Vd contain a new ingredient: the terms in the expression for Vd 
proportional to g[ 2 represent D— term contributions due to the extra U(1)n which are not 
present in the MSSM or NMSSM. The soft SUSY breaking terms are collected in V so ft- 

The term AV represents the contribution of loop corrections to the Higgs effective 
potential. In the MSSM the dominant contribution to AV comes from the loops involving 
the top-quark and its superpartners because of their large Yukawa coupling. However the 
ESSM contains many new exotic supermultiplets and the RG analysis described in the 
previous section revealed that the Yukawa couplings of the exotic D-quarks to the SM 
singlet field S can be large at the EW scale. Therefore the contribution of D-quarks 
and their superpartners to AV can be enhanced as well. Keeping only leading one-loop 
corrections to the Higgs effective potential in Eq. ()44|) from the top- and exotic quarks 
and their superpartners we find 



AV 
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where fini = K-i < S >= — ^= are masses of exotic quarks, while m^, mf 2 , . and . 
are the masses of the superpartners of the top and .D-quarks which are given by 
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m \ h 



m Q + m U + 2 + 2m t ± 




(46) 
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The couplings g 2 , g', g[ and A in the scalar potential (jBj) do not violate SUSY. More- 
over the gauge couplings g 2 and g' are well known The value of the extra U(1)n 
coupling g[ and the effective U(1)n charges of Hd, H u and S can be determined assuming 
gauge coupling unification (see Eq. (f57|)). The Yukawa coupling A cannot be fixed as di- 
rectly as the gauge couplings. But as we discussed in the previous section the requirement 
of validity of perturbation theory up to the GUT scale leads to an upper bound A < A max . 

A set of soft SUSY breaking parameters in the tree-level Higgs boson potential includes 
the soft masses mf, m|, m 2 s and the trilinear coupling A\. The part of the scalar potential 
(144)1 which contains soft SUSY breaking terms V so f t coincides with the corresponding one 
in the NMSSM when the NMSSM parameters k and A K vanish. Since the only complex 
phase (of \A\) that appears in the tree-level scalar potential ()44jl can easily be absorbed 
by a suitable redefinition of the Higgs fields, CP-invariance is preserved in the Higgs 
sector of the considered model at tree-level. The inclusion of loop corrections draws into 
the analysis many other soft SUSY breaking parameters which define masses of different 
superparticles. Some of these parameters can be complex creating potential sources of 
CP-violation. 

At the physical minimum of the scalar potential (}4*4"|) the Higgs fields develop VEVs 



<H A >=-= 





<S>=^=. 



(47) 



The vacuum configuration ()47j) is not the most general one. Because of the SU(2) invari- 
ance of the Higgs potential ()44|) one can always make < H£ >= by virtue of a suitable 
gauge rotation. Then the requirement < >= 0, which is a necessary condition to 
preserve U(l) em associated with electromagnetism in the physical vacuum, is equivalent 
to requiring the squared mass of the physical charged scalar to be positive. It imposes 
additional constraints on the parameter space of the model. 
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The equations for the extrema of the Higgs boson potential in the directions (}4"Tj) in 
field space read: 

dV 2 XA X A 2 2 2 

_ = msS - — VlV2 + —{v 1+ v 2 ) s+ 

+ 9 4 ( Q^l + Q^l + Qss 2 ) Q s s + dAV -» 



(4S 



2 V / ds 

dV 2 AA A A 2 . 2 2 n 5 V 2 

_ = miVl -—sv 2 + —{v 2 + s)vi + — \v 1 -Vz))v 1 + 

+ Y (Qi% 2 + Q2«a + fe'Wi + = , 

8V 2 AA A A 2 2 2, 9 ( 2 2 A. 

_ = m 2 t;2 - "^^i + yOi + s ) y 2 + -g I v 2 - w i ) ^2+ 

+ y (Qi^i 2 + + Qss 2 J Q 2 ^2 + = , 

where g = \J g 2 + g' 2 . Instead of t>i and t>2 it is more convenient to use tan/3 and t> 
defined above. To simplify the analysis of the Higgs spectrum it is worth to express 
the soft masses m 2 , m 2 ,, m| in terms of s, v, tan/? and other parameters. Because from 
precision measurements we know that v = 246 GeV the tree-level Higgs masses and 
couplings depend on four variables only: 

A, s, tan/3, A x . (49) 
4.2 Z-Z' mixing 

Initially the sector of EWSB involves ten degrees of freedom. However four of them are 
massless Goldstone modes which are swallowed by the W^, Z and Z' gauge bosons. The 
charged W ± bosons gain masses via the interaction with the neutral components of the 
Higgs doublets just in the same way as in the MSSM so that Mw = —v. Meanwhile the 
mechanism of the neutral gauge boson mass generation differs significantly. Letting Z' be 
the gauge boson associated with U(1)n, i-6. 

= B 2fM , Z^ = Wl cos 9 W - B lfM sin 6 W , (50) 

the Z — Z' mass squared matrix is given by 

Mf A 2 



M zz> = I : I , (51) 

where 



A 2 Mf, 



ri 9 2 „,2 A 2 _ 99i n , 2 ( r\ „„„2 a /S „ ; „2 



Mf = ^-v , A^ = I Qi cos z (3-Q 2 sm z (3 

1 V ' (52) 

Mf, = g' 2 v 2 1 Q\ cos 2 (3 + Ql sin 2 (3 ) + g' 2 Q 2 s 2 . 
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The eigenvalues of this matrix are 



Mf + M|, =f a/(M| - M|,) 2 + 4A 4 



(53) 



The eigenvalues M| and M| correspond to the mass eigenstates Zi and Z 2 which are 
linear superpositions of Z and Z 1 

Z\ — Z cos ctzz 1 + Z 7 sin azz 1 , Z 2 = — Z sin a^z' + Z' cos azz' , 

1 / 2A 2 \ ( 54 ) 

a ^ = 2 arCtan Ul,-Ml J • 

Phenomenological constraints typically require the mixing angle azz' to be less than 
2 — 3 x 10~ 3 and the mass of the extra neutral gauge boson to be heavier than 
500 — 600 GeV jSTj. A suitable mass hierarchy and mixing between Z and Z' are main- 
tained if the field S acquires a large VEV s > 1.5 TeV. Then the mass of the lightest 
neutral gauge boson Z\ is very close to Mz whereas the mass of Z 2 is set by the VEV of 
the singlet field M Z2 ^ M z > ~ g[Qs s. 

4.3 Charged Higgs 

Due to electric-charge conservation the charged components of the Higgs doublets are not 
mixed with neutral Higgs fields. They form a separate sector whose spectrum is described 
by a 2 x 2 mass matrix. Its determinant has zero value leading to the appearance of two 
Goldstone states 

G~ = H- cos - H+* sin j3 , (55) 

which are absorbed into the longitudinal degrees of freedom of the gauge boson. 
Their orthogonal linear combination 

H + = HJ* sin + H+cosfi (56) 

gains mass 

2 V2XA X A 2 2 g 2 2 

mH± = - Y v + Y V +A± " (57) 

In the leading one-loop approximation the corrections to the charged Higgs boson mass 

A± in the ESSM are almost the same as in the MSSM where the parameter [i has to be 
As 

replaced by — j=. The explicit expressions for the leading one-loop corrections to rn 2 H± in 
the MSSM can be found in 
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4.4 CP-odd Higgs 

The imaginary parts of the neutral components of the Higgs doublets and imaginary 
part of the SM singlet field S compose the CP-odd (or pseudoscalar) Higgs sector of the 
considered model. This sector includes two Goldstone modes Go, G' which are swallowed 
by the Z and Z' bosons after EWSB, leaving only one physical CP-odd Higgs state A. 
In the field basis (A, G', Go) one has 

A = Ps sin ip + P cos if , 

G' = P s cos(f - P sin ip , (58) 
G = \/2(im H° d cos p-ImH° sin f3) , 

where 

P = V2(Im H° d sin (3 + ImH® cos (3) , 

(59) 

Ps = y2ImS, tano? = — sin 2(3. 

2s 

Two massless pseudoscalars Go and G' decouple from the rest of the spectrum whereas 
the physical CP-odd Higgs boson A acquires mass 

2 V2XA X 

m A = , v + A A , (60) 
sin 2ip 

where is the contribution of loop corrections. In the leading one-loop approxima- 
tion the expressions for the mass of the pseudoscalar Higgs boson in the ESSM and PQ 
symmetric NMSSM coincide. The CP-odd Higgs sector of the NMSSM and one-loop 
corrections to it were studied in jSH]- In phenomenologically acceptable models, in which 
the singlet VEV is much larger than v, (p goes to zero and the physical pseudoscalar is 
predominantly the superposition of the imaginary parts of the neutral components of the 
Higgs doublets, i.e. P. 

4.5 CP— even Higgs 

The CP-even Higgs sector involves Re H d , Re and Re S. In the field space basis 
(h, H, N) rotated by an angle f3 with respect to the initial one 

ReH° d = (hcosp - Hsinp + Vl )/V2, 

ReH^ = (hsm(3 + Hcosf3 + v 2 )/V2, (61) 
ReS = (s + N)/V2, 
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the mass matrix of the Higgs scalars takes the form [60] : 



/ d 2 V 1 d 2 V d 2 V \ 
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(62) 



33 / 



\ dvds v dsd(3 d 2 s J 



Taking second derivatives of the Higgs boson effective potential and substituting m 2 , m 2 ,, 



ml 



from the minimisation conditions ()48)1 one obtains: 
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In Eq. (I63J) Ay represents the contribution of loop corrections which in the leading one- 
loop approximation are rather similar to the ones calculated in the NMSSM. The one-loop 
corrections to the mass matrix of the NMSSM CP-even Higgs sector were analysed in |59 3 , 

When the SUSY breaking scale Ms and VEV of the singlet field are considerably larger 
than the EW scale the mass matrix (pj2*)) -()63 |) has a hierarchical structure. Therefore the 
masses of the heaviest Higgs bosons are closely approximated by the diagonal entries M| 2 
and M| 3 which are expected to be of the order of M| or even higher. All off-diagonal 
matrix elements are relatively small < M$Mz- As a result the mass of one CP-even 
Higgs boson (approximately given by H) is governed by while the mass of another 
one (predominantly the singlet field) is set by Mz>- Since the minimal eigenvalue of 
the mass matrix (|62j) - (pT3"|) is always less than its smallest diagonal element at least one 
Higgs scalar in the CP-even sector (approximately h) remains light even when the SUSY 
breaking scale tends to infinity, i.e. m 2 hi < M\ x . 

The direct Higgs searches at LEP set stringent limits on the parameter space of su- 
persymmetric extensions of the SM. In order to establish the corresponding restrictions 
on the parameters of the ESSM we need to specify the couplings of the neutral Higgs 
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particles to the Z boson. In the rotated field basis (h, H, N) the trilinear part of the La- 
grangian, which determines the interaction of the neutral Higgs states with the Z boson, 
is simplified: 



Lazh — ^MzZi^Zi^h + 2^!a* 



H(d^A) - {d»H)A 



(64) 



Here we assume that the mixing between Z and Z' is negligibly small and can be safely 
ignored so that Z\ ~ Z . In the considered case only one CP-even component h couples 
to a pair of Z bosons while another one H interacts with the pseudoscalar A and Z\ . The 
coupling of h to the Z\ pair is exactly the same as in the SM. In the Yukawa interactions 
with fermions the first component of the CP-even Higgs basis also manifests itself as a 
SM-like Higgs boson. 

The couplings of the Higgs scalars to a Z\ pair (gzzi, i = 1, 2, 3) and to the Higgs 
pseudoscalar and Z boson (gzAi) appear because of the mixing of h and H with other 
components of the CP-even Higgs sector. Following the traditional notations we define the 
normalised -R-couplings as: gzzhi = Rzzi x SM coupling; gzAh t = —RzAi- The absolute 
values of all .R-couplings vary from zero to unity. 

The components of the CP-even Higgs basis are related to the physical CP-even Higgs 
eigenstates by virtue of a unitary transformation: 

(65) 



H 
\ N J 



h 2 



Combining the Lagrangian (jHlj) and relations (jfiHj) the normalised .R-couplings may be 
written in terms of the mixing matrix elements according to 



R 



ZZi 



u hhi ) 



RzAi 



(66) 



If all fundamental parameters are real the CP-even Higgs mass matrix (|52j) -()63J ) is sym- 
metric and the unitary transformation (jHB^l reduces to an orthogonal one. The orthogo- 
nality of the mixing matrices U results in sum rules: 



/]Rzzi 



ZAi 



RzZiRzAi — . 



(67) 



The conditions (JBTj) allow to eliminate three -R-couplings. As a result, in the limit 
&zz' — * the interactions of the neutral Higgs particles with a Z boson are described by 
three independent -R-couplings. The dependence of spectrum and couplings of the Higgs 
bosons on the parameters of the ESSM will be examined in the following section. 
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5. Higgs phenomenology 



5.1 Higgs masses and couplings 
5.1.1 The MSSM limit A -> 0, s -> oo 

First of all we consider the spectrum and couplings of the Higgs bosons in the ESSM. Let 
us start from the MSSM limit of the ESSM when A — > 0, s — > oo with fi e ff ~ As held 
fixed in order to give an acceptable chargino mass and EWSB. From the first minimisation 
conditions (jjHj) it follows that such solution can be obtained for very large and negative 
values of m| only. 

As s — > oo the CP-even Higgs state, which is predominantly a singlet field, Z' boson 
and all exotic quarks and non-Higgsinos become very heavy and decouple from the rest 
of the particle spectrum. Then by means of a small unitary transformation the CP-even 
Higgs mass matrix in Eq. f!62D reduces to the block diagonal form [B2] 
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(68) 
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For small values of A the top-left 2x2 submatrix in Eq. (jfiHjl reproduces the mass matrix 
of the CP-even Higgs sector in the MSSM. So at tree-level we find 

\/2AA A 
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(69) 



In Eq. (|69|) the terms of 0(A 2 f 2 ) are omitted, and s 2 ^> v 2 is assumed. 

Since the enlargement of s leads to the growth of the mass of the singlet dominated 
Higgs state mh 3 , which is very close to Mz>, the mixing between N and neutral components 
of the Higgs doublets diminishes when A tends to zero. Thus in the MSSM limit of the 
ESSM the couplings of the heaviest CP-even Higgs boson to the quarks, leptons and 
gauge bosons vanish and the MSSM sum rules for the masses and couplings of the two 
lightest Higgs scalars and pseudoscalar are recovered. As in the minimal SUSY model 
the masses of MSSM-like Higgs bosons are defined by tua and tan/3. They grow if tua 
increases and at large values of vha {m\ >> Mz) the mass of the lightest CP-even Higgs 
boson attains its theoretical upper bound which is determined by the Z boson mass at 
tree-level, i.e. m hl < M z \cos2(3\ 
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5.1.2 \> 9l 



When A > g[ ~ g\ ~ 0.46 the qualitative pattern of the spectrum of the Higgs bosons 
is rather similar to the one which arises in the PQ symmetric NMSSM [64] . We 
first give an analytic discussion of the spectrum at tree-level, then discuss the spectrum 
numerically including one-loop radiative corrections. 

Assuming that in the allowed part of the parameter space M| 2 3> M| 3 3> M\ x the 
perturbation theory method yields 





- M| 2 + 








~ M 2 X - 



M$ 2 



M. 



Mi 2 



/If 4 

23 , ivJ 13 

Ml 



(70) 



Here we neglect all terms suppressed by inverse powers of m 2 A or M§,, i.e. 0(M\jm 
and 0(Mf/M|,). 

At tree-level the masses of the Higgs bosons can written as 
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0(Mf/Mf, 



where 



■sin 2/3. 



As evident from the explicit expression for given above at A 2 ^> (7 2 the last term in 
Eq. ()72j) dominates and the mass of the lightest Higgs boson tends to be negative if the 
auxiliary variable x is not close to unity. In this case the vacuum stability requirement 
constrains the variable x around unity. As a consequence wia is confined in the vicinity of 
\i tan (3 and is much larger than the masses of the Z' and lightest CP-even Higgs boson. 
At so large values of tua the masses of the heaviest CP-even, CP-odd and charged states 
are almost degenerate around m^. 

In Fig. 4 we plot masses and couplings of the Higgs bosons as a function of rriA- As 
a representative example we fix tan/3 = 2 and VEV of the singlet field s = 1.9 TeV, 
that corresponds to Mz> — 700 GeV which is quite close to the current limit on the Z 1 
boson mass. For our numerical study we also choose the maximum possible value of 
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X(M t ) ~ 0.794 which does not spoil the validity of perturbation theory up to the Grand 
Unification scale. In order to obtain a realistic spectrum, we include the leading one- 
loop corrections from the top and stop loops. The contributions of these corrections 
to m A , n^H± and mass matrix of the CP-even Higgs states (p)2*|) - (p)3"j) depend rather 

strongly on the soft masses of the the superpartners of the top-quark (tuq and mfj) 

As 

and the stop mixing parameter X t = A t — . Here and in the following we set 

V2tan/3 

niq = mu = Ms = 700 GeV while the stop mixing parameter is taken to be \/6 M$ in 
order to enhance stop-radiative effects. 

From Fig. 4a it becomes clear that the mass of the lightest Higgs scalar changes 
considerably when rriA varies. At itla below 2 TeV or above 3 TeV the mass squared of 
the lightest Higgs boson tends to be negative. A negative eigenvalue of the mass matrix 
(J()2*|) - (p)3*j) means that the considered vacuum configuration ceases to be a minimum and 
turns into a saddle point. Near this point there is a direction in field space along which the 
energy density decreases generating instability of the given vacuum configuration. The 
requirement of stability of the physical vacuum therefore limits the range of variations of 
rriA from below and above. Together with the experimental lower limit on the mass of 
the Z' boson it maintains the mass hierarchy in the spectrum of the Higgs particles seen 
in Figs. 4b and 4c. Relying on this mass hierarchy one can diagonalise the 3x3 mass 
matrix of the CP-even Higgs sector. 

The numerical results in Figs. 4a-4c confirm the analytic tree-level results discussed 
earlier. The numerical analysis reveals that the masses of the two heaviest CP-even, 
CP-odd and charged Higgs states grow when the VEV of the SM singlet field (or Mz') 
increases. The masses of the heaviest scalar, pseudoscalar and charged Higgs fields also 
rise with increasing A, and tan f3 while the mass of the second lightest Higgs scalar is 
almost insensitive to variations of these parameters. The growth of the masses of heavy 
Higgs bosons caused by the increase of tan (3 or s does not affect much the lightest Higgs 
scalar mass which lies below 200 GeV (see Fig. 4a). 

Turning now to a discussion of the couplings, the hierarchical structure of the mass 
matrix of the CP-even Higgs sector for A > g\ allows one to get approximate solutions 
for the Higgs couplings to the Z boson. They are given by 
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The obtained approximate formulae for the Higgs couplings (|73^1 indicate that 

RzZl S> RzZ2 3> RzZ3 and RzA3 3> RzA2 3> Rzai- 

The analytic discussion of the couplings is confirmed by the numerical results for 
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Rzzi and RzAi shown in Figs. 4d and 4e where the results of our numerical analysis 
including leading one-loop corrections to the CP-even Higgs mass matrix from the top- 
quark and its superpartners are presented. From Eq. (J73"|) as well as from Figs. 4d and 
4e one can see that the couplings of the second lightest Higgs boson to a Z pair and 
to the Higgs pseudoscalar and Z are always suppressed. They are of 0(Mz/Mz>) and 
O^Mz/tua) respectively which is a manifestation of the singlet dominated structure of 
the wave function of the second lightest Higgs scalar. The heaviest CP-even Higgs boson 
is predominantly a superposition of neutral components of Higgs doublets H. This is 
a reason why its relative coupling to the pseudoscalar and Z is so close to unity (see 
Eq. (j64)l ). The main contribution to the wave function of the lightest Higgs scalar gives 
the first component of the CP-even Higgs basis h. Due to this the relative coupling of 
the lightest CP-even Higgs boson to Z pairs tends to unity in the permitted range of 
the parameter space. Because mixing between H and h is extremely small the couplings 
Rzz3 and Rzai are almost negligible, i.e. they are of 0(M§/m^). 

5.1.3 \< 9l 

With decreasing A the qualitative pattern of the Higgs spectrum changes significantly. 
In Fig. 5 the masses of the Higgs particles and their couplings to Z are examined as a 
function of tua for X(M t ) = 0.3. The values of tan/3 and Mz> are taken to be the same 
as in Fig. 4. For A < g[ ~ g± ~ 0.46 the allowed range of tua enlarges because mixing 
between the first and third components of the CP-even Higgs basis reduces. In particular 
the mass squared of the lightest Higgs boson remains positive even when rriA ~ Mz, as 
shown in Fig. 5a. Therefore the lower bound on the Higgs pseudoscalar mass disappears 
so that charged, CP-odd and second lightest CP-even Higgs states may have masses in 
the 200 — 300 GeV range (see Figs. 5b and 5c). But the requirement of vacuum stability 
still prevents having very high values of itia (or x). Indeed from Eq. (|72*|) it is obvious 
that very large values of x (or itia) pulls the mass squared of the lightest Higgs boson 
below zero destabilising the vacuum. This sets upper limits on the masses of charged and 
pseudoscalar Higgs bosons. 

At least one scalar in the Higgs spectrum is always heavy since it has almost the same 
mass as the Z' boson, which must be heavier than 600 GeV. The mass of this CP-even 
Higgs state is determined by the VEV of the singlet field and does not change much if 
the other parameters A, tan/? and tua vary. As before the masses of the other CP-even, 
CP-odd and charged Higgs fields grow when tua rises providing the degeneracy of the 
corresponding states at rriA 3> Mz- The growth of tan /3 and s enlarges the allowed range 
of rriA increasing the upper limit on the pseudoscalar mass. The permitted interval for 
rriA is also expanded when A diminishes. 
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The couplings of the neutral Higgs bosons to Z depend rather strongly on the value 
of the pseudoscalar mass. At small values of rriA the second lightest Higgs scalar gains 
a relatively low mass. Because of this the mixing between H and h is large and relative 
couplings of the lightest Higgs scalars to Z pairs and to the pseudoscalar and Z are of the 
order of unity (see Figs. 5d and 5e). The couplings of the heaviest CP-even Higgs state 
to other bosons and fermions are tiny in this case since it is predominantly a singlet field. 
If the lightest Higgs scalar and pseudoscalar had low masses and large couplings to the 
Z they could be produced at LEPII. Non-observation of these particles at LEP rules out 
most parts of the ESSM parameter space for rriA < 200 GeV. 

When rriA is much larger than Mz but is less than Mz> the heaviest Higgs scalar state 
is still singlet dominated which makes its couplings to the observed particles negligibly 
small. The hierarchical structure of the CP-even Higgs mass matrix ensures that the 
lightest and second lightest Higgs scalars are predominantly composed of the first and 
second components of the CP-even Higgs basis respectively. Therefore Rzzi and Rzai 
are very close to unity while Rzz2 and Rzai are suppressed. When uia approaches the Z' 
boson mass the mixing between S and H becomes large. This leads to appreciable values 
of the Rza2 and Rzaz couplings as displayed in Fig. 5e. However both of these relative 
couplings may be simultaneously large only in a very narrow part of the parameter space 
where rriA — Mz<- At the same time the relative couplings of the heaviest Higgs scalars 
to Z pairs are still much less than unity in this range of parameters because the mixing 
between the first and the other components of the CP-even Higgs basis remains very 
small (see Fig. 5d). Further increasing ttla mimics the mass hierarchy of the CP-even 
Higgs sector appeared at A > g x . As a result the pattern of the Higgs couplings is rather 
similar to the one shown in Figs. 4d and 4e. 

5.2 Upper bound on the lightest CP— even Higgs boson mass 

It is apparent from Figs. 4b and 5b, as well as our analytic considerations, that at some 
value of rriA (or x) the lightest CP-even Higgs boson mass attains its maximum value. 
This coincides with the theoretical upper bound on given by the first element of the 
mass \[M\ X . In this subsection we shall obtain an absolute upper bound on the lightest 
CP-even Higgs boson mass in the ESSM, and compare it to similar bounds obtained in 
the MSSM and NMSSM. 

5.2.1 Tree-level upper bound 

At tree-level the lightest Higgs scalar mass is obtained from Eq. (fT2j) where the first 
three terms on the right-hand side are positive definite, while the fourth term is always 
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negative, and the upper bound therefore corresponds to taking this term to be zero. 
The contribution of the extra U(1)n D-tevm to the upper limit on may be closely 
approximated as 



Using this approximation, the tree-level upper bound on the lightest CP-even Higgs 
boson is given by: 



The first and second terms are similar to the tree-level terms in the NMSSM ^3]. The 
extra U(1)n effect appears through the third term in Eq. (J72|) which is a contribution 
coming from the additional Z7(1)jv D- term in the Higgs scalar potential |65| . 

At tree-level the theoretical restriction on the lightest Higgs mass in the ESSM de- 
pends on A and tan /3 only. As it was noticed in section 3 the requirement of validity of 
perturbation theory up to the Grand Unification scale constrains the interval of variations 
of the Yukawa coupling A for each value of tan/3. The allowed range of A as a function of 
tan/3 was shown in Fig. 3. Using the results of the analysis of the RG flow in the ESSM 
one can obtain the maximum possible value of the lightest Higgs scalar for each particular 
choice of tan (3. 

In Fig. 6a we plot maximum values of the square roots of different contributions in 
Eq. (|75j) to the tree-level upper limit on versus tan/3. It is clear that at moderate 
values of tan j3 ~ 1 — 3 the term \ 2 v 2 /2 sin 2 2/3 from the F-term involving the singlet field 
dominates. With increasing tan/3 it falls quite rapidly and becomes negligibly small as 
tan/3 > 15. In contrast the contribution of the SU(2) and U(l)y -D-terms grows when 
tan/3 becomes larger. At tan/3 > 4 it exceeds X 2 v 2 /2 sin 2 2/3 and gives the dominant 
contribution to the tree-level upper bound on m^. As one can see from Fig. 6a the D— 
term of the extra U(1)n gives the second largest contribution to the tree-level theoretical 
restriction on at very large and low values of tan/3, when tan/3 is less than 1.6 or 
larger than 8. In the part of the ESSM parameter space where the upper limit on 
reaches its absolute maximum value its contribution is the smallest one. According to 
Eq. (|75|) the square root of the U(1)n D-tevm contribution to rr? hx varies from 45 to 
34GeV when tan/3 changes from 1.1 to 14. 

The resulting tree-level upper bound on the mass of the lightest Higgs particle in 
the ESSM is presented in Fig. 6b, and compared to the corresponding bounds in the 
MSSM and NMSSM. In the ESSM the bound attains a maximum value of 130 GeV at 
tan/3 = 1.5 — 1.8. Remarkably, we find that in the interval of tan/3 from 1.2 to 3.4 the 
absolute maximum value of the mass of the lightest Higgs scalar in the ESSM is larger than 
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the experimental lower limit on the SM-like Higgs boson even at tree-level. Therefore 
non-observation of the Higgs boson at LEP does not cause any trouble for the ESSM, 
even at tree-level. 

The upper bound on the mass of the lightest CP-even Higgs scalar in the NMSSM 
exceeds the corresponding limit in the MSSM because of the extra contribution to m\ 
induced by the additional F-term in the Higgs scalar potential of the NMSSM. The size 
of this contribution, which is described by the first term in Eq. (|75|). is determined by 
the Yukawa coupling A whose interval of variations is constrained by the applicability of 
perturbation theory at high energies. The upper limit on the coupling A caused by the 
validity of perturbation theory in the NMSSM is more stringent than in the ESSM due to 
the presence of exotic 5 + 5-plets of matter in the particle spectrum of the ESSM. Indeed 
extra SU(5) multiplets of matter change the running of the gauge couplings so that their 
values at the intermediate scale rise when the number of new supermultiplets increases. 
Since gt(Q) occurs in the right-hand side of the differential equations (13~%|) with negative 
sign the growth of the gauge couplings prevents the appearance of the Landau pole in 
the evolution of the Yukawa couplings. It means that for each value of the top-quark 
Yukawa coupling (or tan/3) at the EW scale the maximum allowed value of X(M t ) rises 
when the number of 5 + 5-plets increases. The increase of X(M t ) is accompanied by the 
growth of the theoretical restriction on the mass of the lightest CP-even Higgs particle. 
For instance, it was shown that the introduction of four pairs of 5 + 5 supermultiplets 
in the NMSSM raised the two-loop upper limit on the lightest Higgs boson mass from 
135 GeV to 155 GeV jHEj- This is also a reason why the tree-level theoretical restriction 
on m/u in the Next-to-Minimal SUSY model is considerably less than in the ESSM at 
moderate values of tan f3. 

At large tan/5 3> 10 the contribution of the F-term of the SM singlet field to m% ll 
vanishes. Therefore with increasing tan/? the upper bound on the lightest Higgs boson 
mass in the NMSSM approaches the corresponding limit in the minimal SUSY model. 
In the ESSM the theoretical restriction on the mass of the lightest Higgs scalar also 
diminishes when tan/3 rises. But even at very large values of tan/3 the tree-level upper 
limit on in the ESSM is still 6 — 7 GeV larger than the ones in the MSSM and NMSSM 
because of the Z7(1)jv -D-term contribution. 

5.2.2 One— loop upper bound 

So far we have discussed the bounds at tree-level. Now we shall include radiative correc- 
tions in our discussion. It is well known that the inclusion of loop corrections from the 
top-quark and its superpartners increases the bound on the lightest Higgs boson mass in 
the ESSM substantially. In the ESSM and in the NMSSM these corrections are nearly the 
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same as in the MSSM. The leading one-loop and two-loop corrections to the lightest Higgs 
boson mass in the MSSM were calculated and studied in |HZj and |HH] — EOHl respectively. 
However, in contrast with the MSSM and NMSSM, the ESSM contains extra supermul- 
tiplets of exotic matter. Because it is not clear a priori if the corrections induced by 
the loops involving new particles affect the mass of the lightest Higgs scalar considerably, 
we include in our analysis leading one-loop corrections to m\ from the exotic quarks 
since their couplings to the singlet Higgs field tend to be large at low energies enhancing 
radiative effects. In the leading approximation the upper bound on the lightest Higgs 
boson mass in the ESSM can be written as 

\2 yi#2 / 1 \ 2 

m 2 hi < -v 2 sin 2 2(3 + M% cos 2 2(3 + -f [\ + - cos 2(3 j + A' n + Aft , (76) 

where the third term represents the U(1)n -D-term contribution while and A^ are 
one-loop corrections from the top-quark and D-quark supermultiplets respectively. When 
m 2 Di = m^. = M| the contribution of one-loop corrections to m 2 hi from the superpartners 
of .D-quarks reduces to 

A n ?>\ 2 K 2 V 2 . 2 „ „ , 

i=l,2,3 

In Figs. 7a and 7b we explore the dependence of one-loop upper bound on the lightest 
Higgs boson mass on the Yukawa couplings Ki and A. We consider two different cases 
when K\ = k 2 = 0, k 3 = k (see Fig. 7a) and K\ = k 2 = = k (see Fig. 7b). To simplify 
our analysis the soft masses of the superpartners of exotic and top-quarks are set to be 
equal, i.e. m 2 Q = mfj = m 2 Di = m|>. = M|. In order to enhance the contribution of loop 
effects we assume maximal mixing in the stop sector (X t = \^6Ms) and minimal mixing 
between the superpartners of exotic quarks D and D, i.e. A Ki = 0. As before we keep 
Ms = Mz> = 700 GeV and tan/? = 2. Then the theoretical restriction on the mass of the 
lightest Higgs scalar (|T6|) is defined by the couplings A and k only. 

In the plane X/ht — n/ht the set of points that results in the same upper limit on 
forms a line. For any choice of A and k lying below the line the lightest Higgs particle 
has a mass which is less than the theoretical restriction that corresponds to this line. 
Curvature of the line characterises the dependence of the upper bound on the lightest 
Higgs boson mass on the Yukawa coupling k. If k is zero the one-loop contribution of the 
exotic squarks to vanishes. When k grows the exotic squark contribution to and 
the upper limit on the mass of the lightest Higgs scalar rise. As a consequence the same 
theoretical restriction on is obtained for smaller values of X(M t ). But from Figs. 7a 
and 7b one can see that the increase of n(M t ) within the allowed range of the parameter 
space does not lead to the appreciable decrease of X(M t ) that should compensate the 
growth of exotic squark contribution to . It means that the contribution of the exotic 
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squarks is always much smaller than the first term in Eq. (|76j) . Numerically the increase 
of the lightest Higgs boson mass caused by the inclusion of the exotic squark contribution 
does not exceed a few GeV. 



5.2.3 Two— loop upper bound 

We also include in our analysis leading two-loop corrections to m? from the top-quark 
and its superpartner. In the two-loop leading-log approximation the upper bound on the 
lightest Higgs boson mass in the ESSM can be written in the following form 
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Here we keep one-loop leading-log corrections from the exotic squarks. Eq. (J7%|) is a 
simple generalisation of the approximate expressions for the theoretical restriction on the 
mass of the lightest Higgs particle obtained in the MSSM [SH] and NMSSM [70]. The 
inclusion of leading two-loop corrections reduces the upper limit on significantly and 
nearly compensates the growth of the theoretical restriction on with increasing SUSY 
breaking scale Ms which is caused by one-loop corrections. 

The dependence of the two-loop upper bound ((75)) on A and k for two different choices 
of the Yukawa couplings of exotic quarks described above is examined in Figs. 7c and 
7d. After the incorporation of two-loop corrections the line that corresponds to the 
160 GeV upper limit on the lightest Higgs boson mass lies beyond the permitted range of 
the parameter space while in the one-loop approximation even larger values of are 
allowed. The distortion of the lines, which represent different theoretical restrictions on 
the mass of the lightest Higgs scalar in the ESSM, still remains negligible. It demonstrates 
the fact that the exotic squark contribution to m 2 hi is much less than the leading two-loop 
corrections from the top-quark and its superpartners to 

From Fig. 7 it follows that for each given value of tan/3 the mass of the lightest 
Higgs particle attains its maximum when X(M t ) — > A max and k — > 0. Nevertheless the 
dependence of the upper limit ()78|) on k is rather weak so that the theoretical restriction 
on the lightest Higgs boson mass for k = and for k = g[ are almost identical. The 
upper limit on rrih 1 is very sensitive to the choice of A and tan (3. Therefore at the last 
stage of our analysis we explore the dependence of the two-loop upper bound (f7H|) on 
tan (3 keeping k = (i.e. Af^ = 0) and relying on the results of our study of the RG flow 
summarised in Fig. 3. 
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The dependence of the two-loop theoretical restrictions on on tan/3 shown in 
Figs. 8a and 8b resembles the tree-level one. But the interval of variations of the upper 
bound on shrinks. In Figs. 8a and 8b we consider maximal (X t = \/6Ms) and 
minimal (X t = 0) mixing in the stop sector respectively. Again at moderate values 
of tan/3 = 1.6 — 3.5 the upper bound on the lightest Higgs boson mass in the ESSM is 
considerably higher than in the MSSM and NMSSM because of the enhanced contribution 
of the F-term of the SM singlet field to m| . Although the two-loop theoretical restriction 
on m/jj in the ESSM reduces with increasing tan (3 it still remains 4 — 5 GeV larger than the 
corresponding limits in the MSSM and NMSSM owing to the U(1)n D-term contribution. 
This contribution is especially important in the case of minimal mixing between the 
superpartners of the top quark. In the considered case the two-loop theoretical restriction 
on m/ ll in the MSSM and NMSSM is less than the experimental limit on the SM-like Higgs 
boson mass set by LEPII. As a result the scenario with X t = is ruled out in the MSSM. 
The contribution of an extra U(1)n D-term to m? raises the upper bound (J7H|) at large 
tan/3 > 10 slightly above the existing LEP limit thus relaxing the constraints on the 
ESSM parameter space (see Fig. 8b). 

The growth of X t from to V0M5 increases the theoretical restriction on the lightest 
Higgs boson mass in the ESSM by 10 — 20 GeV. The upper limit on m/^ is most sensitive 
to the choice of X t at low and large values of tan /3 where the growth of the corresponding 
theoretical restriction reaches 20 and 15 GeV respectively. At the same time the absolute 
maximum value of the lightest Higgs boson mass rises by 10 GeV only. In total leading 
one-loop and two-loop corrections modify the maximum possible value of the mass of the 
lightest Higgs scalar by 20 GeV by increasing it up to about 150 GeV. 

Note that the quoted upper limits for the ESSM, as well as the MSSM and NMSSM, 
are sensitive to the value of the top-quark mass, and the SUSY breaking scale, and 
depend on the precise form of the two-loop approximations used. Here we have used 
an analytic approximation of the two-loop effects which slightly underestimates the full 
two-loop corrections. We have also taken the SUSY scale to be given by 700 GeV. The 
upper bounds quoted here may therefore be further increased by several GeV by making 
slightly different assumptions. The main point we wish to make is that the upper bound 
on the lightest CP-even Higgs scalar in the ESSM is always significantly larger than in 
the NMSSM, as well as the MSSM. 
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6. Charginos and Neutralinos 



6.1 Chargino and neutralino states in the ESSM 



After EWSB all superpartners of the gauge and Higgs bosons get non-zero masses. Since 
the supermultiplets of the Z' boson and SM singlet Higgs field S are electromagnetically 
neutral they do not contribute any extra particles to the chargino spectrum. Consequently 
the chargino mass matrix and its eigenvalues remain the same as in the MSSM, namely 

l -\M 2 2 +£ ff + 2M 2 w ± 

(79) 
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where M 2 is the SU{2) gaugino mass and fi e ff = —=. Unsuccessful LEP searches for 

V2 

SUSY particles including data collected at y/s between 90 GeV and 209 GeV set a 95% 
CL lower limit on the chargino mass of about 100 GeV [H]. This lower bound constrains 
the parameter space of the ESSM restricting the absolute values of the effective /i-term 
and M 2 from below, i.e. |M 2 |, \(i eff \ > 90 - 100 GeV. 

In the neutralino sector of the ESSM there are two extra neutralinos besides the four 
MSSM ones. One of them is an extra gaugino coming from the Z' vector supermultiplet. 
The other one is an additional Higgsino S (singlino) which is a fermion component of the 
SM singlet superfield S. The Higgsino mass terms in the Lagrangian of the ESSM are 
induced by the trilinear interaction \S(HdH u ) in the superpotential (|T9*j) after the break- 
down of gauge symmetry. Because of this their values are determined by the coupling A 
and VEVs of the Higgs fields. The mixing between gauginos and Higgsinos is proportional 
to the corresponding gauge coupling and VEV that the scalar partner of the considered 
Higgsino gets. Taking this into account one can obtain a 6 x 6 neutralino mass matrix 
that in the interaction basis (B, W3, H®, H 2 , S, B') reads 
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where Mi, M 2 and M[ are the soft gaugino masses for B, W3 and B' respectively. In 
Eq. (JHUj) we neglect the Abelian gaugino mass mixing M n between B and B' that arises 
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at low energies as a result of the kinetic term mixing even if there is no mixing in the 
initial values of the soft SUSY breaking gaugino masses near the Grand Unification or 
Planck scale • The top-left 4x4 block of the mass matrix ()80|) contains the neutralino 
mass matrix of the MSSM where the parameter \x is replaced by yU e //. The lower right 
2x2 submatrix represents extra components of neutralinos in the considered model. The 
neutralino sector in Eq inspired SUSY models was studied recently in |2Hj, |2SJ) EH], 

E5H33, SOI, 

As one can see from Eqs. (|79 |) — (|80 |1 the masses of charginos and neutralinos depend 
on A, s, tan/5, Mi, M[ and M.%. In SUGRA models with uniform gaugino masses at the 
Grand Unification scale the RG flow yields a relationship between Mi, M[ and Mi at the 
EW scale: 

M[ ~ Mi ~ 0.5M 2 . (81) 

This reduces the parameter space in the neutralino sector of the ESSM drastically. It 
allows to study the spectrum of chargino and neutralino as a function of only one gaugino 
mass, for example Mi, for each set of A, s and tan/3. 

6.2 Chargino and neutralino spectrum 

The qualitative pattern of chargino and neutralino masses is determined by the Yukawa 
coupling A, depending on whether A is less than g[ or not. Because in the MSSM limit 
of the ESSM, when A — > 0, the phenomenologically acceptable solution implies that 
s > Mz/X, the extra U(1)n gaugino B' and singlino S decouple from the rest of the 
spectrum forming two eigenstates (B' ±5)/ v2 with mass Mz> = Qs9i s ■ Mixing between 
new neutralino states and other gauginos and Higgsinos vanishes in this case rendering 
the neutralino sector in the ESSM indistinguishable from MSSM at the LHC and ILC. 
Here it is worth to emphasise that the direct observation of extra neutralino states in the 
ESSM is unlikely to occur in the nearest future anyway. Since off-diagonal entries of the 
bottom right 2x2 submatrix of the neutralino mass matrix (|80|) are controlled by the Z' 
boson mass new neutralinos are always very heavy (~ 1 TeV) preventing the distinction 
between the ESSM and MSSM neutralino sectors. 

When A > g[ the typical pattern of the spectrum of neutralinos and charginos changes. 
In Figs. 9a and 9b we examine the dependence of the neutralino and chargino masses on 
Mi assuming the unification of the soft gaugino mass parameters at the scale Mx- As a 
representative example we fix A ~ 0.794, tan/3 = 2 and Mz> = 700 GeV (s ~ 1.9 TeV). 
We restrict our consideration to the most attractive part of the parameter space, in which 
the lightest chargino is accessible at future colliders, i.e. \M\\ < 300 GeV. In order to 
get the spectrum of neutralinos we diagonalise the mass matrix (jgUj) numerically. As a 
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consequence we obtain a set of positive and negative eigenvalues of this matrix which are 
presented in Fig. 9a. However the physical meaning is only their absolute values. 

In the considered part of the parameter space the heaviest chargino and neutralinos 
are almost degenerate with mass |/i e //|- They are formed by the neutral and charged 
superpartners of the Higgs bosons. As one can see from Figs. 9a and 9b the masses of 
the heaviest chargino and neutralinos are almost insensitive to the choice of the gaugino 
masses if \M ± \ < 300 GeV. The U(1)n gaugino B' and singlino S compose two other 
heavy neutralino eigenstates whose masses are closely approximated as 



\m v o 

1 A3, 4 1 



M[ 2 + 4M§, =f M[ 



(82) 



The four heaviest neutralinos and chargino gain masses beyond 500 GeV range so that 
their observation at the LHC and ILC looks rather problematic. The masses of the 
heaviest neutralino and chargino states rise with increasing VEV of the SM singlet field 
and are practically independent of tan (3. 

At low energies heavy neutralinos decouple and the spectrum of the two lightest ones 
is described by the 2x2 mass matrix 
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whose eigenvalues are 

'- M 1 + M 2 



1 Xl 2 1 
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where 



M M , sin 2 6 W + Mi cos 2 9 W 



The superpartners of charged SU(2) gauge bosons form the lightest chargino state with 
mass 



Mo 



sin 2(3 



(85) 



The numerical analysis and our analytic consideration show that the masses of the lightest 
neutralinos and chargino do not change much when A, s or tan (3 vary unless Mi and M 2 are 
quite small. The second lightest neutralino and the lightest chargino are predominantly 
superpartners of the SU(2) gauge bosons. Their masses are governed by \M 2 \. The 
lightest neutralino state is basically bino, B, whose mass is set by \M±\. 
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In Figs. 10a and 10b we explore the spectrum of neutralino and chargino in the case 
when A is less than g[. The Yukawa coupling A is taken to be 0.3 while the other parame- 
ters remain the same as in Fig. 9. Now the two heaviest neutralinos are mixtures of B' and 
S. They get masses larger than 500 GeV as before. However unlike in the large A limit 
the other four neutralinos and both charginos can be light enough. Therefore they may 
be observed in the nearest future. The composition of the wave functions of the lightest 
neutralinos and charginos depends on the choice of the parameters of the model. For the 
set of A, tan (3 and s chosen in Fig. 10 the lightest neutralino is still predominantly bino, 
B. Till \M\\ is less than 200 GeV, i.e. | Af2 1 < \^eff\, the second lightest neutralino and 
the lightest chargino are basically formed by the superpartners of ST/ (2) gauge bosons. 
When | Mi | > 200 GeV (|M 2 | > \fi e ff\) the wave functions of the second lightest neutralino 
and the lightest chargino are Higgsino dominated. 

Obvious disadvantage of the considered scenarios with A < g[ and A > g[ in the ESSM 
is that any pattern of the masses and couplings of the lightest neutralino and chargino, 
which can be observed at the LHC and ILC, may be reproduced in the framework of the 
minimal SUSY model. This is a consequence of the stringent lower bound on the mass of 
the Z' boson set by Tevatron. 

7. Z' and exotic phenomenology 

7.1 Masses and couplings of new states 

The presence of a Z' gauge boson and exotic multiplets of matter in the particle spectrum 
is a very peculiar feature that permits to distinguish Eq inspired supersymmetric models 
from the MSSM or NMSSM. At tree-level the masses of these new particles are determined 
by the VEV of the singlet field S that remains a free parameter in the considered models. 
Therefore the Z' boson mass and the masses of exotic quarks and non-Higgses cannot 
be predicted. But collider experiments jSHl^jSZI and precision EW tests [Hj set stringent 
limits on the Z' mass and Z — Z' mixing. The lower bounds on the Z' mass from 
direct searches at the Fermilab Tevatron (pp — ► Z' — > |HZ| are model dependent 

but are typically around 500 — 600 GeV unless couplings of ordinary particles to Z' are 
suppressed such as in leptophobic models [23], [23- Similarly, bounds on the mixing 
angle are around (2 — 3) x 10~ 3 [56J. As has been already mentioned, even more stringent 
constraints on the Z' mass and mixing follow from nucleosynthesis and astrophysical 
observations. They imply that the equivalent number of additional neutrinos with full- 
strength weak interactions AN U is less than 0.3 (for a recent review, see [ZH])- This requires 
Mz> > 4.3 TeV [42] • However these restrictions cannot be applied to the Z' gauge boson 
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in the ESSM because right-handed neutrinos here are expected to be superheavy and do 
not change the effective number of neutrino species at low energies. 

The analysis performed in [77] revealed that Z 1 boson in the E$ inspired models can 
be discovered at the LHC if its mass is less than 4 — 4.5 TeV. At the same time the 
determination of the couplings of the Z' should be possible up to Mz> ~ 2 — 2.5 TeV [78 . 
Possible Z' decay channels in Eq inspired supersymmetric models were studied in \7'A\ . 

The restrictions on the masses of exotic particles are not so rigorous as the experimental 
bounds on the mass of the Z' boson. The most stringent constraints come from the non- 
observation of exotic colour states at HERA and Tevatron. But most searches imply that 
exotic quarks, i.e leptoquarks or diquarks, have integer-spin. So they are either scalars 
or vectors. Because of this new coloured objects can be coupled directly to either a pair 
of quarks or to quark and lepton. Moreover it is usually assumed that leptoquarks and 
diquarks have appreciable couplings to the quarks and leptons of the first generation. 
Experiments at LEP, HERA and Tevatron excluded such leptoquarks if their masses were 
less than 290 GeV (THj whereas CDF and DO ruled out diquarks with masses up to 420 GeV 
[5U] . The production of diquarks at the LHC was studied recently in [8*T] . 

In the ESSM the exotic squarks and non-Higgses are expected to be heavy since their 
masses are determined by the SUSY breaking scale. Moreover, their couplings to the 
quarks and leptons of the first and second generation should be rather small to avoid 
processes with non-diagonal flavour transitions. As a result the production of exotic 
squarks and non-Higgses will be very strongly suppressed or even impossible at future 
colliders. However the exotic fermions (quarks and non-Higgsinos) can be relatively light 
in the ESSM since their masses are set by the Yukawa couplings Ki and \ that may be 
small. This happens, for example, when the Yukawa couplings of the exotic particles 
have hierarchical structure similar to the one observed in the ordinary quark and lepton 
sectors. Then Z' mass lie beyond 10 TeV and the only manifestation of the considered 
model may be the presence of light exotic quark or non-Higgses in the particle spectrum. 

The new exotic particles consist of vector-like multiplets with respect to the SM 
gauge group. Hence their axial couplings to the SM gauge bosons go to zero in the limit 
of no Z — Z' mixing reducing the contribution of additional particles to the electroweak 
observables measured at LEP. The contribution of Z' gauge boson to the electroweak 
observables is also negligibly small because it is supposed to be very heavy so that the 
mixing between Z and Z' almost vanishes. 

In order to amplify the signal coming from the presence of additional particles we 
shall assume further that the three families of exotic quarks and two generations of ex- 
otic non-Higgsinos, whose masses are determined by extra Yukawa couplings, are con- 
siderably lighter than the Z' and in this case they can possibly be observed at the 
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LHC and ILC. Since the analysis of the RG flow performed in section 3 revealed that 
the exotic quarks as well as non-Higgsino Yukawa couplings tend to be equal we keep 

fJ>Di = HD2 = = ~^f~ s and = ^ H2 = ~^7f~^" s (Ai(M t ) = A 2 (M t )) at the EW 
scale. Moreover to simplify our numerical studies we fix the masses of exotic quarks and 
non-Higgsinos to be equal to 300 GeV. 

Before proceeding to discuss the scope of future colliders in testing the features of 
the ESSM in the Z' and exotic sectors, we should remind the reader that we assume 
the mixing angle between the Z and Z' to be extremely small. In this case, any vertex 
involving a Z' boson and fermions can be written as 



gv - 9a15 • (86) 



For, e.g. M' z = 1.5 TeV, the vector gv(M z >) and axial g A (M z >) couplings take the follow- 
ing values: 

• charged leptons: gv = Qe L — Qe c L — 0.1081, g A = Qe c L + Qe L — 0.4910 ; 

• neutrinos: 9v = 9a = Qu l = 0.2996 ; 

• w-quarks: g v = Q UL - Q ul ~ 0.0278, g A = Q ul + Q UL ~ 0.2996 ; 

• d-quarks: g v = Q dh - Q dl ~ -0.1637, g A = Q dl + Q dL ~ 0.4910 ; 

• exotic D-quarks: gv = Qd — Qd — 0.1359, 9a = Qd + Qd — —0.7906 ; 

• fermion partners of extra non-Higgs fields (non-Higgsinos): 

gv = Q Hl - Qh 2 ^ -0.1915 , g A = Q H2 + Q Hl ~ -0.7906 ; 



fermion partners of extra singlet fields (singlinos): 

9v = 9a = Qs — 0.7906 . 



As for additional couplings, the interaction of exotic quarks and non-Higgsinos with 
the neutral SM gauge bosons 7 and Z takes the form 

_• n JJL 

respectively, where Q em and gv are given as follows: 

• exotic D-quarks: Qf m = — 1/3 , gv = — 2Q^sin 2 Q w ; 

• charged non-Higgsinos: Qf m = -1 , g v = - 2Q f em sin 2 6 W ~ - cos 29 w ; 
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• neutral non-Higgsinos: Q^ m = , gy — 1 . 

For completeness and to fix our conventions, we also quote the couplings of the 7 and Z 
bosons to ordinary quarks and leptons, as 

• ordinary fermions (quarks and leptons): g v = T% — 2Q{ m sin 2 9w , 9a = T( . 
7.2 Phenomenology at future colliders 

Fig. 11 shows the differential distribution in invariant mass of the lepton pair (for 
one species of lepton I — e, /i) in Drell-Yan production at the LHC, assuming the SM 
only as well as the latter augmented, in turn, by a Z' field (Mz> = 1.5 TeV) with and 
without light exotic quarks or non-Higgsinos (fiDi = fJ>m = 300 GeV) separately 7 . This 
distribution is promptly measurable at the CERN collider with a high resolution and 
would enable one to not only confirm the existence of a Z' state but also to establish the 
possible presence as well as nature of additional exotic matter, by simply fitting to the 
data the width of the Z' resonance [7H]. In fact for our choice of /i£>i, y-m and Mz> the 
Z' total width varies from « 19 GeV (in case of no exotic matter) to ~ 25 GeV (in case 
of light exotic L>-quarks) and to ~ 21 GeV (in case of light non-Higgsinos). (Also notice 
the different normalisation around the Z' resonance of the three curves in Fig. 11, as this 
scales like ~ YiZ 1 — > l + l~)/T(Z' — > anything).) Clearly, in order to perform such an 
exercise, the Z' couplings to ordinary matter ought to have been previously established 
elsewhere, as a modification of the latter may well lead to effects similar to those induced 
by the additional matter present in our model. (Recall that in our model Z' couplings to 
SM particles and exotic matter are simultaneously fixed.) 

However, if exotic particles of the nature described here do exist at such low scales, they 
could possibly be accessed through direct pair hadropro duct ion. In fact, the corresponding 
fully inclusive cross sections are in principle sufficient to such a purpose in the case of 
exotic /^-quarks (up to masses of the TeV order) while this statement is presumably true 
for non-Higgsinos only up to masses of few hundred GeV. (Notice that the former are 
generated via gluon-induced QCD interactions while the latter via quark-induced EW 
ones.) This should be manifest as a close inspection of Fig. 12. 

In practice, detectable final states do depend on the underlying nature of the exotic 
particles. The lifetime and decay modes of the latter are determined by the operators that 
break the Z^ symmetry. When is broken significantly exotic fermions can produce 
a remarkable signature 8 . Since according to our initial assumptions the Z^ symmetry is 

7 Recall that we assume three identical generations of the former but only two of the latter. Besides, 

we allow the existence of only one at a time of either. 

8 If Z2 is only slightly broken exotic quarks and non-Higgsinos may live for a long time. Then exotic 
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mostly broken by the operators involving quarks and leptons of the third generation the 
exotic quarks decay either via 



D ^t + b, D ->& + *, 

if exotic quarks Di are diquarks or via 

D^t + f, D^r + t, 

D — > b + u T , D — > z/ T + 6 , 

if exotic quarks of type -D are leptoquarks. Because in general sfermions decay into 
corresponding fermion and neutralino one can expect that each diquark will decay further 
into t- and 5-quarks while a leptoquark will produce a t-quark and r-lepton in the 
final state with rather high probability. Thus the presence of light exotic quarks in the 
particle spectrum could result in an appreciable enhancement of the cross section of either 
pp — > tibb + X and pp — > bbbb + X if exotic quarks are diquarks or pp — > ttr + T~ + X 
and consequently pp — > bbr + T~ + X if new quark states are leptoquarks 9 . In compliance 
with our initial assumptions non-Higgsinos decay predominantly into either quarks and 
squarks or leptons and sleptons of the third generation as well, i.e. 

H° -> t + t, 
H°^b + ~b, 

H°^T + T, 

H~ —>t + b, 
H~ -> V T + f . 

If we assume again that a sfermion decays predominantly into the corresponding fermion 
and neutralino then also the production of non-Higgsinos should lead to a significant 
enlargement of the cross sections of QQQ^Q^ and QQt + t~ production, where Q is a 
heavy quark of the third generation, that allows to identify these particles if they are light 
enough. 

As each t-quark decays into a 6-quark whereas a r-lepton gives one charged lepton / 
in the final state with a probability of 35%, both these scenarios would generate an excess 
in the 6-quark production cross section. In this respect SM data samples which should 
be altered by the presence of exotic D-quarks or non-Higgsinos are those involving tt 





-> t + t, 


H°- 


^b + l, 


H°- 


-> r + t , 


H~ 


-> b + J, 


H~ -> 


T + V T , 



quarks will form compound states with ordinary quarks. It means that at future colliders it may be 
possible to study the spectroscopy of new composite scalar leptons or baryons. Also one can observe 
quasi-stable charged colourless fermions with zero lepton number. 

9 It is worth to remind here that the production cross sections of pp — > iibb + X and pp — > ttr+r - + X 

in the SM are suppressed at least by a factor ( — J and ( J respectively as compared to the cross 

section of it pair production (and, similarly, for i-quarks replaced by 6-quarks). 
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production and decay as well as direct bb production. For this reason, Fig. 13 also shows 
the cross sections for these two genuine SM processes alongside those for the exotica. 
Detailed LHC analyses will be required to establish the feasibility of extracting the excess 
due to the light exotic particles predicted by our model. However, Fig. 13 should clearly 
make the point that - for the discussed parameter configuration - one is in a favourable 
position in this respect, as the rates for the exotica times their BRs into the aforementioned 
decay channels are typically larger than the expected four-body cross sections involving 
heavy quarks and/or leptons. 

The situation will experimentally be much easier at a future ILC Here, under the 
same assumptions as above concerning their decay patterns, both species of exotic par- 
ticles should contribute to the inclusive hadronic cross section, see Fig. 14. Assuming, 
again, the mass choice /loi = = 300 GeV, the onset at 600 GeV of the exotic pair 
production threshold would clearly be visible above the SM continuum (with or without 
a much heavier Z' , again, with M z > = 1.5 TeV). The rise of the hadronic cross section 
at y/s — 2/i Di — 2/i Hi would be different, depending on the kind of exotic particles being 
generated, owning to the different EW charges involved and the fact that three genera- 
tions of light -D's can be allowed in our model as opposed to only two in the case of light 
if's (as already intimated). Furthermore, the line shape of the Z' resonance would be 
different too, depending on whether one or the other kind of exotic matter is allowed. 
Both the enormous luminosity and extremely clean environment of an ILC, joined with 
a significant degree of control on the beam energy spread, should allow one to explore in 
detail all such possible features of the hadronic cross section. In fact, as the actual value 
of the ILC beam energy has yet to be fixed and our illustrative choice for /i Di and /iffi m &y 
not correspond to what nature has chosen, we present in Fig. 15 the mass dependence of 
the pair production cross section for our exotic states at two reference collider energies, of 
700 GeV and identical to the Z' mass. While the scope for exotic -D-quark production at 
the ILC has probably little to add to what could be obtained earlier at the LHC, a TeV 
scale e + e~ linear collider is definitely crucial in increasing the discovery reach in mass for 
non-Higgsinos beyond the limits obtainable at the CERN hadronic machine. 

8. Conclusions 

In this paper we have made a comprehensive study of the theory and phenomenology of 
a low energy supersymmetric standard model originating from a string-inspired E e grand 
unified gauge group, which we called Exceptional Supersymmetric Standard Model, or 
ESSM for short. The ESSM considered here is based on the low energy SM gauge group 
together with an extra Z' corresponding to an extra U(1)n gauge symmetry under which 
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right-handed neutrinos have zero charge. This allows right-handed neutrinos to gain 
large Majorana masses, resulting in the conventional (high-scale) seesaw mechanism for 
neutrino masses. The extra U(1)n gauge symmetry survives to the TeV scale, and forbids 
the term [iHdH u in the superpotential, but permits the term \S{H u Hd), where S is a low 
energy singlet that carries U(1)n charge and breaks the gauge symmetry when it develops 
its VEV, giving rise to a massive Z' and an effective /x term. Therefore the \x problem of 
the MSSM is solved in a similar way to that in the NMSSM, but without the accompanying 
problems of singlet tadpoles or domain walls since there is no S* 3 term, and the would-be 
Goldstone boson is eaten by the Z' . 

The low energy matter content of the ESSM corresponds to three 27 representations 
of the Eq symmetry group, to ensure anomaly cancellation, plus an additional pair of 
Higgs-like doublets as required for high energy gauge coupling unification. The ESSM is 
therefore a low energy alternative to the MSSM or NMSSM. The ESSM involves extra 
matter beyond the MSSM contained in three 5 + 5* representations of SU (5), plus a total 
of three SU(5) singlets which carry U(1) N charges. Thus there are three families of new 
exotic charge 1/3 quarks and non-Higgs multiplets predicted in the ESSM, in addition to 
the Z'. 

As in the MSSM, the gauge symmetry of the ESSM does not forbid baryon and lepton 
number violating interactions that result in rapid proton decay. The straightforward 
generalisation of R-parity, assuming that the exotic quarks carry the same baryon number 
as the ordinary ones, guarantees not only proton stability but also the stability of the 
lightest exotic quark. The presence of heavy stable exotic quarks, that should survive 
annihilation, is ruled out by different experiments. Therefore the R-parity definition in 
the ESSM has to be modified. There are two different ways to impose an appropriate 
Z 2 symmetry that lead to two different versions of the ESSM where baryon and lepton 
number is conserved. ESSM version I implies that exotic quarks have twice larger baryon 
number than the ordinary quark fields. In the ESSM version II exotic quarks carry baryon 
and lepton numbers simultaneously. 

Because the supermultiplets of exotic matter interact with the quark, lepton and Higgs 
superfields the Lagrangian of the ESSM includes many new Yukawa couplings. In general 
these couplings give rise to the processes with non-diagonal flavour transitions that have 
not been observed yet. In order to suppress flavour changing processes and to provide the 
correct breakdown of gauge symmetry we assumed a hierarchical structure of the Yukawa 
interactions, and imposed an approximate Z^ symmetry under which all superfields are 
odd except Higgs doublets (H u and H d ) and singlet field S. With these assumptions only 
one SM singlet field S may have appreciable couplings with exotic quarks and SU(2) 
doublets Hu and H 2 i and the couplings are flavour diagonal. It also follows that only one 
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pair of SU (2) Higgs doublets Hd and H u have Yukawa couplings to the ordinary quarks 
and leptons of order unity. The Yukawa couplings of other exotic particles to the quarks 
and leptons of the first two generations must be less than 1CT 4 and 1CT 3 respectively 
in order to suppress FCNCs. We would like to emphasise that from the perspective of 
REWSB these assumptions are completely natural. Without loss of generality it is always 
possible to work in a basis where only one family of singlets S and Higgs doublets Hd and 
H u have VEVs and the remaining states do not (the non-Higgs). Then REWSB makes 
it natural that the so defined Higgs fields have large couplings to third family quarks and 
leptons, while the non-Higgs fields have small couplings. 

We have analysed the RG flow of the gauge and Yukawa couplings in the framework of 
the ESSM taking into account kinetic term mixing between U(l)y and U(1)n- Imposing 
the gauge coupling unification at high energies we have found that the gauge coupling of 
the extra U(1)n is very close to the U(l)y gauge coupling while the off-diagonal gauge 
coupling which describes the mixing between U(l)y and U(1)n is negligibly small. Since 
by construction extra exotic quarks and non-Higgses fill in complete SU(5) representa- 
tions the Grand Unification scale remains almost the same as in the MSSM. At the same 
time the overall gauge coupling g Q that characterises gauge interactions above the scale 
M x is considerably larger than in the MSSM: g ~ 1.21. The increase of the gauge cou- 
plings at the Grand Unification and intermediate scales in the ESSM is caused by the 
extra supermultiplets of exotic matter. 

The growth of Qi(Q) relaxes the restrictions on the Yukawa couplings coming from 
the validity of perturbation theory up to the scale M x as compared with the MSSM. 
In particular h t and A can take larger values at the EW scale than in the constrained 
MSSM and NMSSM. If the top-quark Yukawa coupling is large at the Grand Unification 
scale, i.e. h t (M x ) > 1, the solutions of the RG equations for the Yukawa couplings in 
the gaugeless limit approach the invariant line and along this line are attracted to the 
quasi-fixed point where A(M t ) is going to zero. After the inclusion of gauge couplings, 
the valley along which the solutions of RG equations flow to the fixed point disappear 
but their convergence to the fixed point becomes even stronger. The analysis of the RG 
flow shows that the Yukawa couplings of top- and exotic quarks tend to dominate over 
the Yukawa couplings of non-Higgs supermultiplets that are considerably larger than A 
at the EW scale. However the solutions for the Yukawa couplings are concentrated near 
the fixed points only when ht(Mx) is large enough that corresponds to tan/5 ~ 1 — 1.1. 
At moderate and large values of tan (3 the values of the Yukawa couplings at the EW scale 
may be quite far from the stable fixed point. As a result for values of tan/3 > 1.5 the 
coupling A (M t ) can be comparable with the top-quark Yukawa coupling. 

We have used the above theoretical restrictions on tan (3 and A for the analysis of the 
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Higgs, neutralino and chargino sectors of the ESSM. Although the particle content of 
the ESSM involves many particles with similar quantum number only one singlet field S 
and two Higgs doublets H u and H d acquire VEVs breaking the SU(2) x U(l) Y x U(l) N 
symmetry. Since the Higgs sector of the ESSM contains only one new field S and one 
additional parameter compared to the MSSM it can be regarded as the simplest extension 
of the Higgs sector of the MSSM. As in the MSSM, the ESSM Higgs sector does not provide 
extra sources for the CP-violation at tree-level. The ESSM Higgs spectrum includes three 
CP-even, one CP-odd and two charged states. The singlet dominated CP-even state is 
always almost degenerate with the Z' gauge boson. The masses of another CP-even and 
charged Higgs fields are set by the mass of pseudoscalar state ttia- The lightest CP-even 
Higgs boson is confined around the EW scale. The superpartners of the Z' boson and 
singlet field S also contribute to the ESSM neutralino spectrum while the number of states 
in the chargino sector remain the same as in the MSSM. The masses of extra states in 
the neutralino sector are governed by Mz>- 

The qualitative pattern of the Higgs, neutralino and chargino spectra in the ESSM is 
determined by the Yukawa coupling A. When A << g 1 (the MSSM limit of the ESSM) 
new states in the Higgs and neutralino sectors become very heavy and decouple from the 
rest of the spectrum making them indistinguishable from the MSSM ones. In the case 
when A > g\ the lightest Higgs scalar can be heavier than in the MSSM and NMSSM. In 
this case the vacuum stability requirement constrains so that the heaviest CP-even, 
CP-odd and charged states lie beyond the TeV range. It means that in this case only 
the lightest Higgs scalar can be discovered at the LHC and ILC. We have found that the 
mass of the lightest Higgs particle does not exceed 150 GeV. 

If A > gi then the heaviest chargino and neutralino are formed by the neutral and 
charged superpartners of the Higgs doublets H u and Hd- Extra neutralino states are lighter 
than the heaviest one but still too heavy to be observed in the near future. The lightest 
chargino is predominantly superpartner of W ± gauge bosons while the lightest neutralino 
state is basically bino. We have obtained the approximate solutions for the masses and 
couplings of the Higgs particles as well as for the masses of the lightest neutralino and 
chargino. 

As we have already mentioned the ESSM predicts the existence of many new exotic 
quarks and non-Higgsinos. They compose vector-like multiplets of matter with respect 
to the SM gauge group, so that the axial couplings of the SM gauge bosons to exotic 
particles vanish. As a consequence their contributions to the EW observables measured 
at LEP are suppressed by inverse powers of their masses. The contribution of the Z' is 
also negligibly small since the latter is supposed to be very heavy and practically does 
not mix with the Z boson. At the same time Z', exotic quarks and non-Higgsinos can be 
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produced directly at future colliders if they are light enough. The lifetime of new exotic 
particles is defined by the extent to which the Z% symmetry is broken. If Z^ was exact 
the lightest exotic quark would be absolutely stable. Since we have assumed that Zf 
is mainly broken by the operators involving quarks and leptons of the third generation 
the exotic quarks decay into either two heavy quarks QQ or a heavy quark and a lepton 
Qt(u t ), where Q is either a b- or t-quark. If exotic quarks are light enough they will be 
intensively produced at the LHC. In the case when Z^ is broken significantly this results 
in the growth of the cross section of either pp QQQ^Q^ + X or pp — > QQl + l~ + X, 
with I — e, fx. If the violation of the Z^ invariance is extremely small then a set of new 
baryons or composite leptons containing quasi-stable exotic quarks could be discovered 
at the LHC. As compared with the exotic quarks the production of non-Higgsinos will 
be rather suppressed at the LHC. In contrast, at an ILC the production rates of exotic 
quarks and non-Higgsinos can be comparable allowing their simultaneous observation. 
The Z' gauge boson has to be detected at the LHC if it has a mass below 4 — 4.5 TeV. 

The ESSM can in principle be derived from a rank-6 model which naturally arises 
after the breakdown of the E 6 symmetry via the Hosotani mechanism near the string 
or Grand Unification scale M X - The discovery at future colliders of the exotic particles 
and extra Z' boson predicted by the ESSM would therefore represent a possible indirect 
signature of an underlying E 6 gauge structure at high energies, and provide circumstantial 
evidence for superstring theory. 
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Figure captions 

Fig. 1. (a) RG flow of a set of points in the (X/h t )-(K/h t ) plane in the gaugeless 



included. In both cases the energy scale [i is varied from Mx to M t , ht(Mx) = 10, while 
the Yukawa couplings of the exotic quark and non-Higgs supermultiplets of the first and 
second generations are set to zero. Different trajectories correspond to different initial 
conditions for A and k at the scale M X - 

Fig. 2. (a) The allowed range of the parameter space in the (k, / h t )-(X / h t ) plane for 
k>i — K 2 = Ai = A2 = and tan (3 = 2 where the couplings are evaluated at the top mass 



of the exotic quark and non-Higgs supermultiplets of the first and second generations are 
taken to be zero. Different trajectories correspond to different initial conditions at the 
EW scale. The solutions of the RG equations flow from the left to the right when the RG 
scale changes from M t to M X - (c) Upper limit on (n/h t ) versus (X/h t ) for K\ — k 2 — «, 
Ai = A 2 = and tan/3 = 2. (d) The allowed part of the parameter space in the (K/h t )- 
(X/ht) plane for k x = k 2 = k, Ai(M t ) = X 2 (M t ) = X(M t ) and tan/3 = 2. 

Fig. 3. Upper limit on A versus tan (3. 

Fig. 4. Higgs masses and couplings for X(M t ) = 0.794, tan (3 = 2, M z > = M s = 700 GeV 
and X t = \^6M S . (a) The dependence of the lightest Higgs boson mass on m A . (b) One- 
loop masses of the CP-even Higgs bosons versus m A . Solid, dashed and dashed-dotted 
lines correspond to the masses of the lightest, second lightest and heaviest Higgs scalars 
respectively, (c) One-loop masses of the CP-odd, heaviest CP-even and charged Higgs 
bosons versus m A . Dotted, dashed-dotted and solid lines correspond to the masses of 
the charged, heaviest scalar and pseudoscalar states, (d) Absolute values of the relative 
couplings Rzzhi of the Higgs scalars to Z pairs. Solid, dashed and dashed-dotted curves 
represent the dependence of the couplings of the lightest, second lightest and heaviest 
CP-even Higgs states to Z pairs on m A . (e) Absolute values of the relative couplings 
RzAhi of the CP-even Higgs bosons to the Higgs pseudoscalar and Z as a function of m A . 
The notations are the same as in Fig. 4c. 

Fig. 5. Higgs masses and couplings for X(M t ) = 0.3, tan/3 = 2, M z > = M s = 700 GeV 
and X t = y/6M s . (a) The dependence of the lightest Higgs boson mass on m A . (b) 
One-loop masses of the Higgs scalars versus m A . (c) One-loop masses of the CP-odd, 
heaviest CP-even and charged Higgs states versus m A . (d) Absolute values of the relative 




versus 





versus 
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couplings Rzzhi of the CP-even Higgs bosons to Z pairs, (e) Absolute values of the relative 
couplings RzAhi of the Higgs scalars to the Higgs pseudoscalar and Z as a function of tha- 
The notations are the same as in Fig. 4. 



Fig. 6. (a) Different contributions to the tree-level upper bound on m hl in the ESSM 
versus tan/5. Solid line represents the tree-level theoretical restriction on the lightest 
Higgs boson mass in the MSSM: M z \ cos2/5|. Dash-dotted line is a contribution of extra 



U(1)n -D-term: g[v 



Qi cos 2 + Q 2 sin 2 



. Dotted line is the maximum possible contri- 



bution of the F-term corresponding to the SM singlet field S: —j=v sin 2/3. (b) tree-level 

v2 

upper bound on the lightest Higgs boson mass as a function of tan/5. The solid, lower 
and upper dotted lines correspond to the theoretical restrictions on m hl in the MSSM, 
NMSSM and ESSM respectively. 

Fig. 7. (a) One-loop upper bound on the lightest Higgs boson mass as a function of the 
Yukawa couplings in the (A//i t )-(/c//i t ) plane for Ki(M t ) = n 2 (M t ) = and K 3 (M t ) = k. 
(b) One-loop upper limit on versus Yukawa couplings in the (\ / h t )-(n / h t ) plane for 
Ki(M t ) = K 2 (M t ) = K 3 (M t ) = k. (c) Two-loop upper limit on m hl as a function of the 
Yukawa couplings in the (X/h t )-(K/h t ) plane for Ki(M t ) = K 2 (M t ) = and K 3 (M t ) = k. 
(d) Two-loop upper bound on the mass of the lightest Higgs scalar versus Yukawa cou- 
plings in the (X / h t )-(n / h t ) plane for K\{M t ) = K 2 (M t ) = K 3 (M t ) = k. Thick, solid, 
dash-dotted and dashed lines in Figs. 7a-7d correspond to rrih = 160, 150, 140, 130 GeV 
respectively. The dotted line represent the allowed range of the parameter space for 
Xi(Mt) = X 2 (M t ) = 0. Theoretical restrictions on the lightest Higgs boson mass are 
obtained for tan (5 = 2, m 2 Q = mfj = m 2 Di = = M 2 s ,X t = VQM s and M s = 700 GeV. 

Fig. 8. (a) The dependence of the two-loop upper bound on the lightest Higgs boson 
mass on tan/5 for m t (M t ) = 165 GeV, m 2 Q = mfj = M|, X t = y/6M s and M s = 700 GeV. 
The solid, lower and upper dotted lines represent the theoretical restrictions on in 
the MSSM, NMSSM and ESSM respectively, (b) Two-loop upper bound on the mass of 
the lightest Higgs particle in the MSSM, NMSSM and ESSM versus tan (3 for X t = 0. 
Other parameters and notations are the same as in Fig. 8a. 

Fig. 9. (a) Neutralino spectrum in the ESSM as function of Mi for A(M t ) = 0.794, 
tan (3 = 2 and Mz> = 700 GeV. (Only the absolute values of the neutralino masses have 
physical meaning.) (b) Chargino masses versus M x . The parameters are the same as in 
Fig. 9a. 
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Fig. 10. (a) The dependence of neutralino masses in the ESSM on Mi for \{M t ) = 0.3, 
tan (3 = 2 and M z > = 700 GeV. (Only the absolute values of the neutralino masses have 
physical meaning.) (b) Chargino spectrum as function of M 1 . The set of parameters is 
the same as in Fig. 10a. 

Fig. 11. Differential cross section in the final state invariant mass, denoted by M t +i~, 
at the LHC for Drell-Yan production (I — e or /i only) in presence of a Z' with and 
without the (separate) contribution of exotic D-quarks or non-Higgsinos H (both via 
EW interactions), with [i Di = fi Hi = 300 GeV. Here, M z > = 1.5 TeV. 

Fig. 12. Cross section at the LHC for pair production of exotic D-quarks (via QCD 
interactions) as well as non-Higgsinos H (via EW interactions), as a function of their 
(common) mass, denoted by M F . Here, M z > = 1.5 TeV. 

Fig. 13. Differential cross section in the final state invariant mass, denoted by M FF) 
at the LHC for pair production of &-, t- and exotic D-quarks (all via QCD interactions) 
as well as non-Higgsinos H (via EW interactions), with pLm — l^m = 300 GeV. Note the 
rescaling of the rates for the first and last process. Here, M z > = 1.5 TeV. 

Fig. 14. Energy-dependent hadronic cross section at a future ILC in the SM with an 
additional Z', with and without the (separate) contribution of exotic D-quarks or non- 
Higgsinos H (both via EW interactions), with fx Di = \i m = 300 GeV. Here, M z > = 1.5 
TeV. 

Fig. 15. Cross section at a future ILC for pair production of exotic D-quarks and of 
non-Higgsinos H (both via EW interactions), as a function of their (common) mass, , 
denoted by M F , for two collider energies. Here, M z > = 1.5 TeV. 
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